2024-05-10T03:42:40.322 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T03:42:40.322 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} --owner scheduled_jcollin@teuthology --name jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi --verbose -- /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/orig.config.yaml 2024-05-10T03:42:40.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T03:42:40.453 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660 branch: wip-jcollin-testing-07052024 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} email: jcollin@redhat.com first_in_suite: false job_id: '7700660' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-07052024 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: origin-jcollin-testing sha1: 1ef17e831a1b0a2132aa514927b7748adaf73171 owner: scheduled_jcollin@teuthology priority: 2 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9809 sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c sleep_before_teardown: 0 suite: fs:functional suite_branch: origin-jcollin-testing suite_path: /home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa suite_relpath: qa suite_repo: https://github.com/joscollin/ceph.git suite_sha1: 1ef17e831a1b0a2132aa514927b7748adaf73171 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7FdJqdCHwolGpq9tqq5sqt4A6W4cTa2wZdqVnN5Qhtb8LuMx74etxifhyELUMWKVrob5sHcn+JJFd7R3XeRS8= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUGkTzYTWonc2cRDiutYhQBE8zNNzT2G6by0wxOOXpcaq4LiY+1urCib9rfIC2+PQ+1pqBjXL3HW4Bd3chenys= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_03:34:35 tube: smithi user: jcollin verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T03:42:40.453 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa; will attempt to use it 2024-05-10T03:42:40.454 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks 2024-05-10T03:42:40.454 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T03:42:40.456 INFO:teuthology.task.internal:Checking packages... 2024-05-10T03:42:40.480 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c' 2024-05-10T03:42:40.480 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T03:42:40.480 INFO:teuthology.packaging:ref: None 2024-05-10T03:42:40.480 INFO:teuthology.packaging:tag: None 2024-05-10T03:42:40.481 INFO:teuthology.packaging:branch: wip-jcollin-testing-07052024 2024-05-10T03:42:40.481 INFO:teuthology.packaging:sha1: cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-10T03:42:40.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-07052024 2024-05-10T03:42:40.739 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3538.gcd693b0b 2024-05-10T03:42:40.740 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T03:42:40.746 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T03:42:40.746 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T03:42:40.784 INFO:teuthology.task.internal:Saving configuration 2024-05-10T03:42:40.802 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T03:42:40.818 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:42:40.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:37:47.667031', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7FdJqdCHwolGpq9tqq5sqt4A6W4cTa2wZdqVnN5Qhtb8LuMx74etxifhyELUMWKVrob5sHcn+JJFd7R3XeRS8='} 2024-05-10T03:42:40.864 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:37:47.668872', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUGkTzYTWonc2cRDiutYhQBE8zNNzT2G6by0wxOOXpcaq4LiY+1urCib9rfIC2+PQ+1pqBjXL3HW4Bd3chenys='} 2024-05-10T03:42:40.864 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T03:42:40.870 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-10T03:42:40.870 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-10T03:42:40.870 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T03:42:40.966 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efee27d0160>, signals=[15]) 2024-05-10T03:42:40.966 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T03:42:40.972 INFO:teuthology.task.internal:Opening connections... 2024-05-10T03:42:40.972 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:42:40.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:42:41.051 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:42:41.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:42:41.126 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T03:42:41.131 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-05-10T03:42:41.150 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-05-10T03:42:41.150 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T03:42:41.208 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-05-10T03:42:41.209 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:42:41.209 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T03:42:41.209 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T03:42:41.209 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-05-10T03:42:41.235 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-05-10T03:42:41.254 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-05-10T03:42:41.254 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-05-10T03:42:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-05-10T03:42:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-05-10T03:42:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T03:42:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T03:42:41.314 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-05-10T03:42:41.335 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T03:42:41.345 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T03:42:41.401 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T03:42:41.402 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:42:41.405 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-05-10T03:42:41.422 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T03:42:41.435 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T03:42:41.435 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:42:41.461 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-05-10T03:42:41.490 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T03:42:41.546 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T03:42:41.561 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-10T03:42:41.561 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-10T03:42:41.561 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-10T03:42:41.561 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:42:41.562 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T03:42:41.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:42:41.579 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-05-10T03:42:41.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:42:41.580 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-05-10T03:42:41.637 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-437.el9.x86_64 2024-05-10T03:42:41.637 INFO:teuthology.task.kernel:Running kernel on smithi055: 5.14.0-437.el9.x86_64 2024-05-10T03:42:41.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2024-05-10T03:42:41.638 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-437.el9.x86_64 2024-05-10T03:42:41.639 INFO:teuthology.task.kernel:Running kernel on smithi064: 5.14.0-437.el9.x86_64 2024-05-10T03:42:41.639 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum install -y kernel 2024-05-10T03:42:45.147 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.1 MB 00:01 2024-05-10T03:42:45.373 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.1 MB 00:02 2024-05-10T03:42:48.641 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-05-10T03:42:48.656 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 19 MB 00:02 2024-05-10T03:42:53.874 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.2 MB 00:01 2024-05-10T03:42:54.906 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.2 MB 00:02 2024-05-10T03:42:55.267 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 16 kB 00:00 2024-05-10T03:42:56.607 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-05-10T03:42:56.687 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-10T03:42:58.400 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-10T03:43:02.101 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-10T03:43:03.667 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-10T03:43:04.225 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T03:43:04.225 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T03:43:04.316 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-05-10T03:43:04.330 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-05-10T03:43:04.330 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-05-10T03:43:04.330 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-05-10T03:43:04.330 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-05-10T03:43:04.330 INFO:teuthology.orchestra.run.smithi064.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T03:43:04.330 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout:Install 4 Packages 2024-05-10T03:43:04.331 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:43:04.332 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 78 M 2024-05-10T03:43:04.332 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 123 M 2024-05-10T03:43:04.332 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-05-10T03:43:05.228 INFO:teuthology.orchestra.run.smithi064.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 648 kB/s | 484 kB 00:00 2024-05-10T03:43:05.773 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T03:43:05.773 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T03:43:05.855 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T03:43:05.861 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout:Install 4 Packages 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 78 M 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 123 M 2024-05-10T03:43:05.862 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-05-10T03:43:06.143 INFO:teuthology.orchestra.run.smithi055.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.2 MB/s | 484 kB 00:00 2024-05-10T03:43:06.860 INFO:teuthology.orchestra.run.smithi055.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-05-10T03:43:07.394 INFO:teuthology.orchestra.run.smithi055.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 22 MB/s | 28 MB 00:01 2024-05-10T03:43:07.819 INFO:teuthology.orchestra.run.smithi055.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 18 MB/s | 34 MB 00:01 2024-05-10T03:43:07.819 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:43:07.819 INFO:teuthology.orchestra.run.smithi055.stdout:Total 40 MB/s | 78 MB 00:01 2024-05-10T03:43:08.531 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-05-10T03:43:08.929 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-05-10T03:43:08.929 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-05-10T03:43:09.880 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-05-10T03:43:09.880 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-05-10T03:43:12.425 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-05-10T03:43:13.061 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T03:43:13.153 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T03:43:15.952 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T03:43:16.074 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T03:43:19.876 INFO:teuthology.orchestra.run.smithi064.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.0 MB/s | 15 MB 00:15 2024-05-10T03:43:21.151 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T03:43:21.194 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:26.295 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:36.362 INFO:teuthology.orchestra.run.smithi064.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 920 kB/s | 28 MB 00:31 2024-05-10T03:43:38.125 INFO:teuthology.orchestra.run.smithi064.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 1.0 MB/s | 34 MB 00:33 2024-05-10T03:43:38.125 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:43:38.126 INFO:teuthology.orchestra.run.smithi064.stdout:Total 2.3 MB/s | 78 MB 00:33 2024-05-10T03:43:38.831 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-05-10T03:43:39.243 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-05-10T03:43:39.243 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-05-10T03:43:40.177 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-05-10T03:43:40.177 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-05-10T03:43:42.752 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-05-10T03:43:43.409 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T03:43:43.491 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T03:43:46.283 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T03:43:46.417 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T03:43:51.493 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T03:43:51.537 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:56.633 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:57.335 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:57.375 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:57.724 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:57.724 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T03:43:57.724 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T03:43:57.724 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T03:43:58.544 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:43:58.544 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:43:58.544 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-05-10T03:43:58.545 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T03:43:58.545 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T03:43:58.545 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T03:43:58.545 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T03:43:58.545 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:43:58.545 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-05-10T03:43:58.886 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T03:43:58.966 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T03:43:58.966 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T03:43:58.966 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T03:43:58.966 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T03:43:58.966 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T03:43:58.967 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-10T03:43:58.967 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi055.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T03:43:58.967 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T03:43:59.018 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T03:43:59.018 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T03:43:59.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -qi grub2-tools 2024-05-10T03:43:59.049 INFO:teuthology.orchestra.run.smithi055.stdout:Name : grub2-tools 2024-05-10T03:43:59.049 INFO:teuthology.orchestra.run.smithi055.stdout:Epoch : 1 2024-05-10T03:43:59.049 INFO:teuthology.orchestra.run.smithi055.stdout:Version : 2.06 2024-05-10T03:43:59.049 INFO:teuthology.orchestra.run.smithi055.stdout:Release : 68.el9 2024-05-10T03:43:59.049 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: x86_64 2024-05-10T03:43:59.049 INFO:teuthology.orchestra.run.smithi055.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Group : Unspecified 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Size : 8264254 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:License : GPLv3+ 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Packager : builder@centos.org 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Vendor : CentOS 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Summary : Support tools for GRUB. 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:Description : 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:43:59.050 INFO:teuthology.orchestra.run.smithi055.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T03:43:59.051 INFO:teuthology.orchestra.run.smithi055.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T03:43:59.051 INFO:teuthology.orchestra.run.smithi055.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T03:43:59.051 INFO:teuthology.orchestra.run.smithi055.stdout:hardware devices. 2024-05-10T03:43:59.051 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:43:59.051 INFO:teuthology.orchestra.run.smithi055.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T03:43:59.052 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T03:43:59.052 INFO:teuthology.task.kernel:Updating grub on smithi055 to boot 5.14.0-444.el9.x86_64 2024-05-10T03:43:59.052 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T03:43:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2024-05-10T03:44:01.021 INFO:teuthology.orchestra.run.smithi055.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T03:44:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:done 2024-05-10T03:44:01.051 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-05-10T03:44:01.072 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.eVvkyyx9nO 2024-05-10T03:44:01.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eVvkyyx9nO 2024-05-10T03:44:01.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.eVvkyyx9nO 2024-05-10T03:44:01.282 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.eVvkyyx9nO is 6KB 2024-05-10T03:44:01.330 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.eVvkyyx9nO 2024-05-10T03:44:01.346 DEBUG:teuthology.orchestra.run.smithi055:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T03:44:01.421 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T03:44:01.423 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T03:44:01.423 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T03:44:01.423 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T03:44:01.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T03:44:01.574 DEBUG:teuthology.orchestra.run.smithi055:> sudo shutdown -r now 2024-05-10T03:44:27.648 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:44:27.689 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:44:28.063 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:44:28.063 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T03:44:28.063 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T03:44:28.063 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T03:44:28.851 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T03:44:28.851 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:44:28.851 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-05-10T03:44:28.851 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T03:44:28.852 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T03:44:28.852 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T03:44:28.852 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T03:44:28.852 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:44:28.852 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-05-10T03:44:29.231 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T03:44:29.303 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T03:44:29.303 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T03:44:29.303 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T03:44:29.303 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T03:44:29.303 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T03:44:29.303 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-10T03:44:29.303 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi064.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T03:44:29.304 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T03:44:29.355 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T03:44:29.356 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T03:44:29.356 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -qi grub2-tools 2024-05-10T03:44:29.388 INFO:teuthology.orchestra.run.smithi064.stdout:Name : grub2-tools 2024-05-10T03:44:29.388 INFO:teuthology.orchestra.run.smithi064.stdout:Epoch : 1 2024-05-10T03:44:29.388 INFO:teuthology.orchestra.run.smithi064.stdout:Version : 2.06 2024-05-10T03:44:29.388 INFO:teuthology.orchestra.run.smithi064.stdout:Release : 68.el9 2024-05-10T03:44:29.388 INFO:teuthology.orchestra.run.smithi064.stdout:Architecture: x86_64 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Group : Unspecified 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Size : 8264254 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:License : GPLv3+ 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Packager : builder@centos.org 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:Vendor : CentOS 2024-05-10T03:44:29.389 INFO:teuthology.orchestra.run.smithi064.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout:Summary : Support tools for GRUB. 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout:Description : 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout:hardware devices. 2024-05-10T03:44:29.390 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:44:29.391 INFO:teuthology.orchestra.run.smithi064.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T03:44:29.392 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T03:44:29.392 INFO:teuthology.task.kernel:Updating grub on smithi064 to boot 5.14.0-444.el9.x86_64 2024-05-10T03:44:29.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T03:44:29.997 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2024-05-10T03:44:31.449 INFO:teuthology.orchestra.run.smithi064.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T03:44:31.487 INFO:teuthology.orchestra.run.smithi064.stderr:done 2024-05-10T03:44:31.489 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-05-10T03:44:31.510 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.8sV35aN01w 2024-05-10T03:44:31.510 DEBUG:teuthology.orchestra.run.smithi064:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8sV35aN01w 2024-05-10T03:44:31.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.8sV35aN01w 2024-05-10T03:44:31.578 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T03:44:31.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-10T03:44:31.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:44:31.713 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.8sV35aN01w is 6KB 2024-05-10T03:44:31.761 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.8sV35aN01w 2024-05-10T03:44:31.775 DEBUG:teuthology.orchestra.run.smithi064:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T03:44:31.842 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T03:44:31.843 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T03:44:31.843 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T03:44:31.843 INFO:teuthology.orchestra.run.smithi064.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T03:44:31.844 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T03:44:31.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo shutdown -r now 2024-05-10T03:45:02.022 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-10T03:45:02.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-05-10T03:45:02.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:45:31.606 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T03:45:36.546 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-05-10T03:45:40.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-10T03:45:40.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:45:40.974 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-05-10T03:45:41.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-10T03:45:41.401 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-10T03:45:41.402 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-05-10T03:45:41.417 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-444.el9.x86_64 2024-05-10T03:45:41.417 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T03:45:41.417 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T03:45:41.417 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T03:45:42.419 DEBUG:teuthology.parallel:result is None 2024-05-10T03:45:45.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-05-10T03:45:45.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:46:03.934 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-05-10T03:46:15.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-05-10T03:46:15.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:46:17.085 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-05-10T03:46:17.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-05-10T03:46:17.538 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-444.el9.x86_64"... 2024-05-10T03:46:17.539 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-05-10T03:46:17.553 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-444.el9.x86_64 2024-05-10T03:46:17.554 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T03:46:17.554 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T03:46:17.554 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T03:46:18.555 DEBUG:teuthology.parallel:result is None 2024-05-10T03:46:18.555 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T03:46:18.565 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T03:46:18.565 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T03:46:18.568 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T03:46:18.585 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T03:46:18.616 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T03:46:18.666 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T03:46:18.667 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T03:46:18.669 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T03:46:18.703 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T03:46:18.752 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T03:46:18.753 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T03:46:18.755 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T03:46:18.818 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:46:18.837 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:46:18.852 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:46:18.891 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T03:46:18.893 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T03:46:18.901 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T03:46:18.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T03:46:18.904 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T03:46:18.931 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T03:46:18.942 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T03:46:18.942 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T03:46:18.974 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T03:46:18.990 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:46:19.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:46:19.126 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:46:19.212 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:46:19.255 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:46:19.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T03:46:19.322 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:46:19.367 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T03:46:19.409 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:46:19.494 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T03:46:19.535 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:46:19.535 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T03:46:19.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-05-10T03:46:19.627 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-05-10T03:46:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:46:19.707 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:46:20.166 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T03:46:20.172 INFO:teuthology.task.internal:Starting timer... 2024-05-10T03:46:20.172 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T03:46:20.221 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T03:46:20.269 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-10T03:46:20.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-05-10T03:46:20.346 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-05-10T03:46:20.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2024-05-10T03:46:20.408 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2024-05-10T03:46:20.410 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T03:46:20.411 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-05-10T03:46:20.437 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-05-10T03:46:20.437 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2024-05-10T03:46:20.473 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2024-05-10T03:46:20.473 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi064.front.sepia.ceph.com': 'permissive'} 2024-05-10T03:46:20.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T03:46:20.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:46:20.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T03:46:20.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:46:20.540 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T03:46:20.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-05-10T03:46:20.598 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2024-05-10T03:46:20.632 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T03:46:20.645 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T03:46:20.664 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T03:46:20.665 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T03:50:35.791 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com')] 2024-05-10T03:50:35.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-10T03:50:35.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:50:35.870 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-05-10T03:50:35.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-10T03:50:35.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-05-10T03:50:35.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T03:50:36.032 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-05-10T03:50:36.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-05-10T03:50:36.112 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T03:50:36.123 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T03:50:36.123 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T03:50:36.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:50:36.126 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T03:50:36.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:50:36.158 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T03:50:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T03:50:36.185 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T03:50:36.201 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T03:50:36.202 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-05-10T03:50:36.214 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-05-10T03:50:36.227 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2024-05-10T03:50:36.230 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T03:50:36.238 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2024-05-10T03:50:36.245 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T03:50:36.253 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T03:50:36.268 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T03:50:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-05-10T03:50:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:50:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-05-10T03:50:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.324 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-05-10T03:50:36.328 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:50:36.328 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-05-10T03:50:36.328 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.328 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.328 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.328 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:50:36.329 INFO:teuthology.run_tasks:Running task install... 2024-05-10T03:50:36.338 DEBUG:teuthology.task.install:project ceph 2024-05-10T03:50:36.339 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}} 2024-05-10T03:50:36.339 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'} 2024-05-10T03:50:36.339 INFO:teuthology.task.install:Using flavor: default 2024-05-10T03:50:36.347 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T03:50:36.347 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T03:50:36.347 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'tag': None, 'wait_for_package': False} 2024-05-10T03:50:36.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-10T03:50:36.350 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'tag': None, 'wait_for_package': False} 2024-05-10T03:50:36.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-10T03:50:36.501 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/ 2024-05-10T03:50:36.502 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gcd693b0b 2024-05-10T03:50:36.566 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/ 2024-05-10T03:50:36.566 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gcd693b0b 2024-05-10T03:50:36.672 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T03:50:36.673 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:50:36.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T03:50:36.675 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-jcollin-testing-07052024/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T03:50:36.675 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:50:36.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T03:50:36.702 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T03:50:36.702 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T03:50:36.704 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T03:50:36.704 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cd693b0b93278c2b128be2d6d93ae4df18c3ba1c/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T03:50:36.768 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T03:50:36.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T03:50:36.845 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T03:50:36.849 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T03:50:36.910 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2024-05-10T03:50:36.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2024-05-10T03:50:36.915 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-05-10T03:50:36.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-05-10T03:50:37.154 INFO:teuthology.orchestra.run.smithi064.stdout:54 files removed 2024-05-10T03:50:37.164 INFO:teuthology.orchestra.run.smithi055.stdout:54 files removed 2024-05-10T03:50:37.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T03:50:37.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T03:50:37.914 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 192 kB/s | 84 kB 00:00 2024-05-10T03:50:37.922 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 185 kB/s | 84 kB 00:00 2024-05-10T03:50:38.315 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-05-10T03:50:38.966 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 3.1 kB/s | 1.9 kB 00:00 2024-05-10T03:50:39.515 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 7.6 kB/s | 12 kB 00:01 2024-05-10T03:50:40.432 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2024-05-10T03:50:40.857 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.1 MB 00:01 2024-05-10T03:50:40.873 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.1 MB 00:00 2024-05-10T03:50:44.684 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 19 MB 00:02 2024-05-10T03:50:45.617 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-05-10T03:50:49.242 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-05-10T03:50:50.760 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-05-10T03:50:50.859 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-05-10T03:50:52.377 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-10T03:50:52.603 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-10T03:50:54.140 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-10T03:50:58.086 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-10T03:50:59.454 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-10T03:51:00.489 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T03:51:00.489 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T03:51:00.501 INFO:teuthology.orchestra.run.smithi064.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T03:51:00.502 INFO:teuthology.orchestra.run.smithi064.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T03:51:00.503 INFO:teuthology.orchestra.run.smithi064.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T03:51:00.504 INFO:teuthology.orchestra.run.smithi064.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T03:51:00.505 INFO:teuthology.orchestra.run.smithi064.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T03:51:00.508 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T03:51:00.508 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T03:51:00.574 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 6.6 k 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-10T03:51:00.594 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 891 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 145 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 1.5 M 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 142 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 3.5 M 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 7.4 M 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 49 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 11 M 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 49 M 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 273 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 764 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 225 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 27 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 18 k 2024-05-10T03:51:00.595 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 32 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 746 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 127 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 161 k 2024-05-10T03:51:00.596 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 320 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 301 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 99 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 86 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 171 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.4 M 2024-05-10T03:51:00.597 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 21 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 34 k 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 2.4 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 274 k 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 4.7 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 17 M 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 16 k 2024-05-10T03:51:00.598 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 25 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 163 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T03:51:00.599 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 500 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T03:51:00.600 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 45 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 135 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T03:51:00.601 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T03:51:00.602 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T03:51:00.603 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T03:51:00.604 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T03:51:00.605 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================= 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout:Install 148 Packages 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 8 Packages 2024-05-10T03:51:00.606 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:00.607 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 226 M 2024-05-10T03:51:00.607 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-05-10T03:51:01.755 INFO:teuthology.orchestra.run.smithi064.stdout:(1/156): ceph-19.0.0-3538.gcd693b0b.el9.x86_64. 9.8 kB/s | 6.6 kB 00:00 2024-05-10T03:51:01.890 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T03:51:01.891 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T03:51:01.905 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T03:51:01.907 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T03:51:01.907 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T03:51:01.907 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T03:51:01.907 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T03:51:01.909 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T03:51:01.910 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T03:51:01.975 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 6.6 k 2024-05-10T03:51:01.996 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 891 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 145 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 1.5 M 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 142 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 3.5 M 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 7.4 M 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 49 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 11 M 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 49 M 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 273 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 764 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 225 k 2024-05-10T03:51:01.997 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 27 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 18 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 32 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 746 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 127 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T03:51:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 161 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 320 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 301 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 99 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 86 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 171 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T03:51:01.999 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.4 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 3.1 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 21 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 34 k 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 2.4 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 274 k 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 4.7 M 2024-05-10T03:51:02.000 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 17 M 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gcd693b0b.el9 ceph-noarch 16 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 25 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 163 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T03:51:02.001 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 500 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 5.4 M 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T03:51:02.002 INFO:teuthology.orchestra.run.smithi055.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T03:51:02.003 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 45 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gcd693b0b.el9 ceph 135 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T03:51:02.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T03:51:02.005 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T03:51:02.006 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T03:51:02.007 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout:Installing weak dependencies: 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-05-10T03:51:02.008 INFO:teuthology.orchestra.run.smithi055.stdout:Install 148 Packages 2024-05-10T03:51:02.009 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 8 Packages 2024-05-10T03:51:02.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:51:02.009 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 226 M 2024-05-10T03:51:02.009 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-05-10T03:51:02.680 INFO:teuthology.orchestra.run.smithi064.stdout:(2/156): ceph-base-19.0.0-3538.gcd693b0b.el9.x8 3.4 MB/s | 5.4 MB 00:01 2024-05-10T03:51:03.089 INFO:teuthology.orchestra.run.smithi055.stdout:(1/156): ceph-19.0.0-3538.gcd693b0b.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-05-10T03:51:03.096 INFO:teuthology.orchestra.run.smithi064.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 347 kB/s | 145 kB 00:00 2024-05-10T03:51:03.138 INFO:teuthology.orchestra.run.smithi064.stdout:(4/156): ceph-fuse-19.0.0-3538.gcd693b0b.el9.x8 644 kB/s | 891 kB 00:01 2024-05-10T03:51:03.697 INFO:teuthology.orchestra.run.smithi055.stdout:(2/156): ceph-fuse-19.0.0-3538.gcd693b0b.el9.x8 1.4 MB/s | 891 kB 00:00 2024-05-10T03:51:03.764 INFO:teuthology.orchestra.run.smithi055.stdout:(3/156): ceph-base-19.0.0-3538.gcd693b0b.el9.x8 5.9 MB/s | 5.4 MB 00:00 2024-05-10T03:51:03.824 INFO:teuthology.orchestra.run.smithi055.stdout:(4/156): ceph-immutable-object-cache-19.0.0-353 1.1 MB/s | 145 kB 00:00 2024-05-10T03:51:04.148 INFO:teuthology.orchestra.run.smithi055.stdout:(5/156): ceph-mds-19.0.0-3538.gcd693b0b.el9.x86 6.2 MB/s | 2.4 MB 00:00 2024-05-10T03:51:04.832 INFO:teuthology.orchestra.run.smithi055.stdout:(6/156): ceph-mgr-19.0.0-3538.gcd693b0b.el9.x86 1.5 MB/s | 1.5 MB 00:01 2024-05-10T03:51:05.165 INFO:teuthology.orchestra.run.smithi055.stdout:(7/156): ceph-mon-19.0.0-3538.gcd693b0b.el9.x86 4.6 MB/s | 4.7 MB 00:01 2024-05-10T03:51:05.322 INFO:teuthology.orchestra.run.smithi064.stdout:(5/156): ceph-common-19.0.0-3538.gcd693b0b.el9. 5.0 MB/s | 21 MB 00:04 2024-05-10T03:51:05.790 INFO:teuthology.orchestra.run.smithi064.stdout:(6/156): ceph-mon-19.0.0-3538.gcd693b0b.el9.x86 10 MB/s | 4.7 MB 00:00 2024-05-10T03:51:06.014 INFO:teuthology.orchestra.run.smithi064.stdout:(7/156): ceph-mgr-19.0.0-3538.gcd693b0b.el9.x86 539 kB/s | 1.5 MB 00:02 2024-05-10T03:51:06.348 INFO:teuthology.orchestra.run.smithi064.stdout:(8/156): ceph-mds-19.0.0-3538.gcd693b0b.el9.x86 745 kB/s | 2.4 MB 00:03 2024-05-10T03:51:07.157 INFO:teuthology.orchestra.run.smithi055.stdout:(8/156): ceph-radosgw-19.0.0-3538.gcd693b0b.el9 5.3 MB/s | 11 MB 00:01 2024-05-10T03:51:07.224 INFO:teuthology.orchestra.run.smithi055.stdout:(9/156): ceph-selinux-19.0.0-3538.gcd693b0b.el9 378 kB/s | 25 kB 00:00 2024-05-10T03:51:07.429 INFO:teuthology.orchestra.run.smithi064.stdout:(9/156): ceph-osd-19.0.0-3538.gcd693b0b.el9.x86 10 MB/s | 17 MB 00:01 2024-05-10T03:51:07.456 INFO:teuthology.orchestra.run.smithi064.stdout:(10/156): ceph-selinux-19.0.0-3538.gcd693b0b.el 23 kB/s | 25 kB 00:01 2024-05-10T03:51:08.157 INFO:teuthology.orchestra.run.smithi064.stdout:(11/156): cephfs-mirror-19.0.0-3538.gcd693b0b.e 321 kB/s | 225 kB 00:00 2024-05-10T03:51:09.549 INFO:teuthology.orchestra.run.smithi055.stdout:(10/156): ceph-common-19.0.0-3538.gcd693b0b.el9 3.2 MB/s | 21 MB 00:06 2024-05-10T03:51:09.616 INFO:teuthology.orchestra.run.smithi055.stdout:(11/156): cephfs-mirror-19.0.0-3538.gcd693b0b.e 3.3 MB/s | 225 kB 00:00 2024-05-10T03:51:09.691 INFO:teuthology.orchestra.run.smithi055.stdout:(12/156): cephfs-shell-19.0.0-3538.gcd693b0b.el 361 kB/s | 27 kB 00:00 2024-05-10T03:51:09.767 INFO:teuthology.orchestra.run.smithi055.stdout:(13/156): libcephfs-devel-19.0.0-3538.gcd693b0b 423 kB/s | 32 kB 00:00 2024-05-10T03:51:09.942 INFO:teuthology.orchestra.run.smithi055.stdout:(14/156): libcephfs2-19.0.0-3538.gcd693b0b.el9. 4.2 MB/s | 746 kB 00:00 2024-05-10T03:51:10.284 INFO:teuthology.orchestra.run.smithi055.stdout:(15/156): libcephsqlite-19.0.0-3538.gcd693b0b.e 478 kB/s | 163 kB 00:00 2024-05-10T03:51:10.393 INFO:teuthology.orchestra.run.smithi055.stdout:(16/156): librados-devel-19.0.0-3538.gcd693b0b. 1.1 MB/s | 127 kB 00:00 2024-05-10T03:51:10.618 INFO:teuthology.orchestra.run.smithi055.stdout:(17/156): libradosstriper1-19.0.0-3538.gcd693b0 2.2 MB/s | 500 kB 00:00 2024-05-10T03:51:11.310 INFO:teuthology.orchestra.run.smithi055.stdout:(18/156): librgw2-19.0.0-3538.gcd693b0b.el9.x86 7.8 MB/s | 5.4 MB 00:00 2024-05-10T03:51:11.377 INFO:teuthology.orchestra.run.smithi055.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gcd 680 kB/s | 45 kB 00:00 2024-05-10T03:51:11.502 INFO:teuthology.orchestra.run.smithi055.stdout:(20/156): python3-ceph-common-19.0.0-3538.gcd69 1.1 MB/s | 135 kB 00:00 2024-05-10T03:51:11.594 INFO:teuthology.orchestra.run.smithi055.stdout:(21/156): python3-cephfs-19.0.0-3538.gcd693b0b. 1.7 MB/s | 161 kB 00:00 2024-05-10T03:51:11.694 INFO:teuthology.orchestra.run.smithi055.stdout:(22/156): python3-rados-19.0.0-3538.gcd693b0b.e 3.1 MB/s | 320 kB 00:00 2024-05-10T03:51:11.756 INFO:teuthology.orchestra.run.smithi064.stdout:(12/156): ceph-test-19.0.0-3538.gcd693b0b.el9.x 11 MB/s | 49 MB 00:04 2024-05-10T03:51:11.782 INFO:teuthology.orchestra.run.smithi064.stdout:(13/156): cephfs-shell-19.0.0-3538.gcd693b0b.el 7.4 kB/s | 27 kB 00:03 2024-05-10T03:51:11.786 INFO:teuthology.orchestra.run.smithi055.stdout:(23/156): python3-rbd-19.0.0-3538.gcd693b0b.el9 3.2 MB/s | 301 kB 00:00 2024-05-10T03:51:11.824 INFO:teuthology.orchestra.run.smithi064.stdout:(14/156): libcephfs-devel-19.0.0-3538.gcd693b0b 476 kB/s | 32 kB 00:00 2024-05-10T03:51:11.878 INFO:teuthology.orchestra.run.smithi055.stdout:(24/156): python3-rgw-19.0.0-3538.gcd693b0b.el9 1.1 MB/s | 99 kB 00:00 2024-05-10T03:51:11.899 INFO:teuthology.orchestra.run.smithi064.stdout:(15/156): libcephsqlite-19.0.0-3538.gcd693b0b.e 2.1 MB/s | 163 kB 00:00 2024-05-10T03:51:11.954 INFO:teuthology.orchestra.run.smithi055.stdout:(25/156): rbd-fuse-19.0.0-3538.gcd693b0b.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-10T03:51:11.974 INFO:teuthology.orchestra.run.smithi064.stdout:(16/156): librados-devel-19.0.0-3538.gcd693b0b. 1.6 MB/s | 127 kB 00:00 2024-05-10T03:51:12.108 INFO:teuthology.orchestra.run.smithi064.stdout:(17/156): ceph-radosgw-19.0.0-3538.gcd693b0b.el 1.7 MB/s | 11 MB 00:06 2024-05-10T03:51:12.150 INFO:teuthology.orchestra.run.smithi064.stdout:(18/156): libradosstriper1-19.0.0-3538.gcd693b0 2.8 MB/s | 500 kB 00:00 2024-05-10T03:51:12.217 INFO:teuthology.orchestra.run.smithi064.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gcd 678 kB/s | 45 kB 00:00 2024-05-10T03:51:12.292 INFO:teuthology.orchestra.run.smithi064.stdout:(20/156): python3-ceph-common-19.0.0-3538.gcd69 1.8 MB/s | 135 kB 00:00 2024-05-10T03:51:12.325 INFO:teuthology.orchestra.run.smithi064.stdout:(21/156): libcephfs2-19.0.0-3538.gcd693b0b.el9. 1.3 MB/s | 746 kB 00:00 2024-05-10T03:51:12.376 INFO:teuthology.orchestra.run.smithi064.stdout:(22/156): python3-cephfs-19.0.0-3538.gcd693b0b. 1.9 MB/s | 161 kB 00:00 2024-05-10T03:51:12.396 INFO:teuthology.orchestra.run.smithi055.stdout:(26/156): rbd-mirror-19.0.0-3538.gcd693b0b.el9. 7.0 MB/s | 3.1 MB 00:00 2024-05-10T03:51:12.451 INFO:teuthology.orchestra.run.smithi064.stdout:(23/156): python3-rbd-19.0.0-3538.gcd693b0b.el9 3.9 MB/s | 301 kB 00:00 2024-05-10T03:51:12.485 INFO:teuthology.orchestra.run.smithi064.stdout:(24/156): python3-rados-19.0.0-3538.gcd693b0b.e 2.0 MB/s | 320 kB 00:00 2024-05-10T03:51:12.518 INFO:teuthology.orchestra.run.smithi064.stdout:(25/156): python3-rgw-19.0.0-3538.gcd693b0b.el9 1.5 MB/s | 99 kB 00:00 2024-05-10T03:51:12.552 INFO:teuthology.orchestra.run.smithi064.stdout:(26/156): rbd-fuse-19.0.0-3538.gcd693b0b.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-10T03:51:12.621 INFO:teuthology.orchestra.run.smithi055.stdout:(27/156): ceph-osd-19.0.0-3538.gcd693b0b.el9.x8 2.2 MB/s | 17 MB 00:07 2024-05-10T03:51:12.636 INFO:teuthology.orchestra.run.smithi064.stdout:(27/156): rbd-nbd-19.0.0-3538.gcd693b0b.el9.x86 2.0 MB/s | 171 kB 00:00 2024-05-10T03:51:12.646 INFO:teuthology.orchestra.run.smithi055.stdout:(28/156): rbd-nbd-19.0.0-3538.gcd693b0b.el9.x86 682 kB/s | 171 kB 00:00 2024-05-10T03:51:12.769 INFO:teuthology.orchestra.run.smithi064.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 256 kB/s | 34 kB 00:00 2024-05-10T03:51:12.788 INFO:teuthology.orchestra.run.smithi055.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3538.g 205 kB/s | 34 kB 00:00 2024-05-10T03:51:12.814 INFO:teuthology.orchestra.run.smithi055.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3538.gcd693b0 852 kB/s | 142 kB 00:00 2024-05-10T03:51:12.820 INFO:teuthology.orchestra.run.smithi064.stdout:(29/156): rbd-mirror-19.0.0-3538.gcd693b0b.el9. 10 MB/s | 3.1 MB 00:00 2024-05-10T03:51:13.000 INFO:teuthology.orchestra.run.smithi064.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3538.gcd693b0 619 kB/s | 142 kB 00:00 2024-05-10T03:51:13.070 INFO:teuthology.orchestra.run.smithi064.stdout:(31/156): librgw2-19.0.0-3538.gcd693b0b.el9.x86 5.6 MB/s | 5.4 MB 00:00 2024-05-10T03:51:13.304 INFO:teuthology.orchestra.run.smithi064.stdout:(32/156): ceph-mgr-dashboard-19.0.0-3538.gcd693 7.3 MB/s | 3.5 MB 00:00 2024-05-10T03:51:13.329 INFO:teuthology.orchestra.run.smithi064.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3538.gcd 1.0 MB/s | 274 kB 00:00 2024-05-10T03:51:13.396 INFO:teuthology.orchestra.run.smithi064.stdout:(34/156): ceph-mgr-rook-19.0.0-3538.gcd693b0b.e 537 kB/s | 49 kB 00:00 2024-05-10T03:51:13.422 INFO:teuthology.orchestra.run.smithi064.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3538.gc 179 kB/s | 16 kB 00:00 2024-05-10T03:51:13.514 INFO:teuthology.orchestra.run.smithi064.stdout:(36/156): ceph-volume-19.0.0-3538.gcd693b0b.el9 2.3 MB/s | 273 kB 00:00 2024-05-10T03:51:13.647 INFO:teuthology.orchestra.run.smithi064.stdout:(37/156): cephadm-19.0.0-3538.gcd693b0b.el9.noa 3.3 MB/s | 764 kB 00:00 2024-05-10T03:51:13.681 INFO:teuthology.orchestra.run.smithi064.stdout:(38/156): cephfs-top-19.0.0-3538.gcd693b0b.el9. 109 kB/s | 18 kB 00:00 2024-05-10T03:51:13.798 INFO:teuthology.orchestra.run.smithi064.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-05-10T03:51:13.881 INFO:teuthology.orchestra.run.smithi064.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-05-10T03:51:13.965 INFO:teuthology.orchestra.run.smithi064.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-10T03:51:13.981 INFO:teuthology.orchestra.run.smithi055.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-05-10T03:51:14.056 INFO:teuthology.orchestra.run.smithi055.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gcd 3.6 MB/s | 274 kB 00:00 2024-05-10T03:51:14.057 INFO:teuthology.orchestra.run.smithi064.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-05-10T03:51:14.106 INFO:teuthology.orchestra.run.smithi055.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gcd693b0b.e 990 kB/s | 49 kB 00:00 2024-05-10T03:51:14.141 INFO:teuthology.orchestra.run.smithi064.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-05-10T03:51:14.165 INFO:teuthology.orchestra.run.smithi055.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gc 282 kB/s | 16 kB 00:00 2024-05-10T03:51:14.224 INFO:teuthology.orchestra.run.smithi064.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-10T03:51:14.248 INFO:teuthology.orchestra.run.smithi055.stdout:(35/156): ceph-volume-19.0.0-3538.gcd693b0b.el9 3.2 MB/s | 273 kB 00:00 2024-05-10T03:51:14.316 INFO:teuthology.orchestra.run.smithi064.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 3.5 MB/s | 1.2 MB 00:00 2024-05-10T03:51:14.340 INFO:teuthology.orchestra.run.smithi055.stdout:(36/156): ceph-mgr-dashboard-19.0.0-3538.gcd693 2.3 MB/s | 3.5 MB 00:01 2024-05-10T03:51:14.341 INFO:teuthology.orchestra.run.smithi064.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-10T03:51:14.399 INFO:teuthology.orchestra.run.smithi055.stdout:(37/156): cephadm-19.0.0-3538.gcd693b0b.el9.noa 5.0 MB/s | 764 kB 00:00 2024-05-10T03:51:14.400 INFO:teuthology.orchestra.run.smithi064.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-10T03:51:14.416 INFO:teuthology.orchestra.run.smithi055.stdout:(38/156): cephfs-top-19.0.0-3538.gcd693b0b.el9. 243 kB/s | 18 kB 00:00 2024-05-10T03:51:14.467 INFO:teuthology.orchestra.run.smithi064.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-05-10T03:51:14.526 INFO:teuthology.orchestra.run.smithi064.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 7.4 MB/s | 943 kB 00:00 2024-05-10T03:51:14.551 INFO:teuthology.orchestra.run.smithi064.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-05-10T03:51:14.593 INFO:teuthology.orchestra.run.smithi064.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 322 kB/s | 21 kB 00:00 2024-05-10T03:51:14.643 INFO:teuthology.orchestra.run.smithi064.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-05-10T03:51:14.668 INFO:teuthology.orchestra.run.smithi064.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-10T03:51:14.719 INFO:teuthology.orchestra.run.smithi064.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-05-10T03:51:14.811 INFO:teuthology.orchestra.run.smithi064.stdout:(55/156): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-05-10T03:51:14.861 INFO:teuthology.orchestra.run.smithi064.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 78 kB/s | 11 kB 00:00 2024-05-10T03:51:14.903 INFO:teuthology.orchestra.run.smithi064.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-05-10T03:51:14.928 INFO:teuthology.orchestra.run.smithi064.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-05-10T03:51:14.995 INFO:teuthology.orchestra.run.smithi064.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-05-10T03:51:15.045 INFO:teuthology.orchestra.run.smithi064.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 510 kB/s | 25 kB 00:00 2024-05-10T03:51:15.071 INFO:teuthology.orchestra.run.smithi064.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-05-10T03:51:15.083 INFO:teuthology.orchestra.run.smithi055.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 117 kB/s | 80 kB 00:00 2024-05-10T03:51:15.096 INFO:teuthology.orchestra.run.smithi064.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 3.4 MB/s | 582 kB 00:00 2024-05-10T03:51:15.121 INFO:teuthology.orchestra.run.smithi064.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-05-10T03:51:15.171 INFO:teuthology.orchestra.run.smithi064.stdout:(64/156): openblas-0.3.21-2.el9.x86_64.rpm 707 kB/s | 35 kB 00:00 2024-05-10T03:51:15.197 INFO:teuthology.orchestra.run.smithi064.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-10T03:51:15.222 INFO:teuthology.orchestra.run.smithi064.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-10T03:51:15.356 INFO:teuthology.orchestra.run.smithi064.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-10T03:51:15.425 INFO:teuthology.orchestra.run.smithi055.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 796 kB/s | 803 kB 00:01 2024-05-10T03:51:15.464 INFO:teuthology.orchestra.run.smithi064.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2024-05-10T03:51:15.531 INFO:teuthology.orchestra.run.smithi064.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-10T03:51:15.590 INFO:teuthology.orchestra.run.smithi064.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-10T03:51:15.624 INFO:teuthology.orchestra.run.smithi064.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 3.3 MB/s | 911 kB 00:00 2024-05-10T03:51:15.691 INFO:teuthology.orchestra.run.smithi064.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-10T03:51:15.741 INFO:teuthology.orchestra.run.smithi064.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-05-10T03:51:15.824 INFO:teuthology.orchestra.run.smithi064.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-10T03:51:15.892 INFO:teuthology.orchestra.run.smithi055.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 241 kB/s | 195 kB 00:00 2024-05-10T03:51:15.950 INFO:teuthology.orchestra.run.smithi064.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-05-10T03:51:15.975 INFO:teuthology.orchestra.run.smithi064.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-05-10T03:51:16.017 INFO:teuthology.orchestra.run.smithi064.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-05-10T03:51:16.034 INFO:teuthology.orchestra.run.smithi064.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-05-10T03:51:16.109 INFO:teuthology.orchestra.run.smithi064.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-05-10T03:51:16.142 INFO:teuthology.orchestra.run.smithi064.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-05-10T03:51:16.176 INFO:teuthology.orchestra.run.smithi064.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-05-10T03:51:16.243 INFO:teuthology.orchestra.run.smithi064.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-05-10T03:51:16.251 INFO:teuthology.orchestra.run.smithi055.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 307 kB/s | 253 kB 00:00 2024-05-10T03:51:16.268 INFO:teuthology.orchestra.run.smithi064.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-10T03:51:16.310 INFO:teuthology.orchestra.run.smithi064.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-10T03:51:16.327 INFO:teuthology.orchestra.run.smithi064.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-05-10T03:51:16.436 INFO:teuthology.orchestra.run.smithi064.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-05-10T03:51:16.461 INFO:teuthology.orchestra.run.smithi064.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-05-10T03:51:16.495 INFO:teuthology.orchestra.run.smithi064.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 949 kB/s | 159 kB 00:00 2024-05-10T03:51:16.537 INFO:teuthology.orchestra.run.smithi064.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-05-10T03:51:16.570 INFO:teuthology.orchestra.run.smithi064.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-05-10T03:51:16.595 INFO:teuthology.orchestra.run.smithi064.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-05-10T03:51:16.645 INFO:teuthology.orchestra.run.smithi064.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-05-10T03:51:16.679 INFO:teuthology.orchestra.run.smithi064.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 528 kB/s | 44 kB 00:00 2024-05-10T03:51:16.734 INFO:teuthology.orchestra.run.smithi055.stdout:(43/156): ceph-test-19.0.0-3538.gcd693b0b.el9.x 5.2 MB/s | 49 MB 00:09 2024-05-10T03:51:16.738 INFO:teuthology.orchestra.run.smithi064.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-05-10T03:51:16.763 INFO:teuthology.orchestra.run.smithi064.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-05-10T03:51:16.814 INFO:teuthology.orchestra.run.smithi064.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-05-10T03:51:16.864 INFO:teuthology.orchestra.run.smithi064.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-05-10T03:51:16.898 INFO:teuthology.orchestra.run.smithi064.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-05-10T03:51:16.956 INFO:teuthology.orchestra.run.smithi064.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-05-10T03:51:16.981 INFO:teuthology.orchestra.run.smithi064.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-05-10T03:51:17.033 INFO:teuthology.orchestra.run.smithi064.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-05-10T03:51:17.057 INFO:teuthology.orchestra.run.smithi064.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-05-10T03:51:17.282 INFO:teuthology.orchestra.run.smithi064.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-05-10T03:51:17.324 INFO:teuthology.orchestra.run.smithi064.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-05-10T03:51:17.343 INFO:teuthology.orchestra.run.smithi055.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 866 kB/s | 1.2 MB 00:01 2024-05-10T03:51:17.358 INFO:teuthology.orchestra.run.smithi064.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-05-10T03:51:17.376 INFO:teuthology.orchestra.run.smithi055.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 95 kB/s | 106 kB 00:01 2024-05-10T03:51:17.408 INFO:teuthology.orchestra.run.smithi064.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 232 kB/s | 19 kB 00:00 2024-05-10T03:51:17.433 INFO:teuthology.orchestra.run.smithi064.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-05-10T03:51:17.459 INFO:teuthology.orchestra.run.smithi064.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-05-10T03:51:17.484 INFO:teuthology.orchestra.run.smithi064.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-05-10T03:51:17.493 INFO:teuthology.orchestra.run.smithi055.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 178 kB/s | 135 kB 00:00 2024-05-10T03:51:17.517 INFO:teuthology.orchestra.run.smithi064.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-10T03:51:17.543 INFO:teuthology.orchestra.run.smithi064.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-10T03:51:17.610 INFO:teuthology.orchestra.run.smithi064.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-05-10T03:51:17.635 INFO:teuthology.orchestra.run.smithi064.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-05-10T03:51:17.660 INFO:teuthology.orchestra.run.smithi064.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 864 kB/s | 43 kB 00:00 2024-05-10T03:51:17.686 INFO:teuthology.orchestra.run.smithi064.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-05-10T03:51:17.711 INFO:teuthology.orchestra.run.smithi064.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2024-05-10T03:51:17.736 INFO:teuthology.orchestra.run.smithi064.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-10T03:51:17.761 INFO:teuthology.orchestra.run.smithi064.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-05-10T03:51:17.837 INFO:teuthology.orchestra.run.smithi064.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-05-10T03:51:17.862 INFO:teuthology.orchestra.run.smithi064.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-05-10T03:51:17.887 INFO:teuthology.orchestra.run.smithi064.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-05-10T03:51:17.913 INFO:teuthology.orchestra.run.smithi064.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-10T03:51:17.946 INFO:teuthology.orchestra.run.smithi064.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-10T03:51:17.963 INFO:teuthology.orchestra.run.smithi064.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-10T03:51:17.980 INFO:teuthology.orchestra.run.smithi064.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 527 kB/s | 18 kB 00:00 2024-05-10T03:51:17.997 INFO:teuthology.orchestra.run.smithi064.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 691 kB/s | 23 kB 00:00 2024-05-10T03:51:18.014 INFO:teuthology.orchestra.run.smithi064.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-05-10T03:51:18.031 INFO:teuthology.orchestra.run.smithi064.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-05-10T03:51:18.073 INFO:teuthology.orchestra.run.smithi064.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-05-10T03:51:18.077 INFO:teuthology.orchestra.run.smithi055.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 170 kB/s | 125 kB 00:00 2024-05-10T03:51:18.090 INFO:teuthology.orchestra.run.smithi064.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 789 kB/s | 46 kB 00:00 2024-05-10T03:51:18.132 INFO:teuthology.orchestra.run.smithi064.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-05-10T03:51:18.149 INFO:teuthology.orchestra.run.smithi064.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 980 kB/s | 58 kB 00:00 2024-05-10T03:51:18.169 INFO:teuthology.orchestra.run.smithi055.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 271 kB/s | 215 kB 00:00 2024-05-10T03:51:18.174 INFO:teuthology.orchestra.run.smithi064.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 780 kB/s | 79 kB 00:00 2024-05-10T03:51:18.199 INFO:teuthology.orchestra.run.smithi064.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-05-10T03:51:18.225 INFO:teuthology.orchestra.run.smithi064.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-10T03:51:18.250 INFO:teuthology.orchestra.run.smithi064.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-05-10T03:51:18.275 INFO:teuthology.orchestra.run.smithi064.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-10T03:51:18.301 INFO:teuthology.orchestra.run.smithi064.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-10T03:51:18.326 INFO:teuthology.orchestra.run.smithi064.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-10T03:51:18.351 INFO:teuthology.orchestra.run.smithi064.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-05-10T03:51:18.385 INFO:teuthology.orchestra.run.smithi064.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-10T03:51:18.410 INFO:teuthology.orchestra.run.smithi064.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 607 kB/s | 51 kB 00:00 2024-05-10T03:51:18.435 INFO:teuthology.orchestra.run.smithi064.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-05-10T03:51:18.460 INFO:teuthology.orchestra.run.smithi064.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-10T03:51:18.477 INFO:teuthology.orchestra.run.smithi055.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 700 kB/s | 689 kB 00:00 2024-05-10T03:51:18.628 INFO:teuthology.orchestra.run.smithi064.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 104 kB/s | 20 kB 00:00 2024-05-10T03:51:18.653 INFO:teuthology.orchestra.run.smithi064.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 998 kB/s | 192 kB 00:00 2024-05-10T03:51:18.678 INFO:teuthology.orchestra.run.smithi064.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2024-05-10T03:51:18.720 INFO:teuthology.orchestra.run.smithi064.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-10T03:51:18.911 INFO:teuthology.orchestra.run.smithi055.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 144 kB/s | 107 kB 00:00 2024-05-10T03:51:19.061 INFO:teuthology.orchestra.run.smithi055.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 37 kB/s | 21 kB 00:00 2024-05-10T03:51:19.062 INFO:teuthology.orchestra.run.smithi064.stdout:(149/156): librados2-19.0.0-3538.gcd693b0b.el9. 8.3 MB/s | 3.4 MB 00:00 2024-05-10T03:51:19.103 INFO:teuthology.orchestra.run.smithi055.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 919 kB/s | 943 kB 00:01 2024-05-10T03:51:19.220 INFO:teuthology.orchestra.run.smithi064.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2024-05-10T03:51:19.262 INFO:teuthology.orchestra.run.smithi064.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-05-10T03:51:19.346 INFO:teuthology.orchestra.run.smithi064.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-05-10T03:51:19.563 INFO:teuthology.orchestra.run.smithi064.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 3.6 MB/s | 1.8 MB 00:00 2024-05-10T03:51:19.596 INFO:teuthology.orchestra.run.smithi064.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 1.3 MB 00:00 2024-05-10T03:51:19.653 INFO:teuthology.orchestra.run.smithi055.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-05-10T03:51:19.755 INFO:teuthology.orchestra.run.smithi064.stdout:(155/156): librbd1-19.0.0-3538.gcd693b0b.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-05-10T03:51:19.820 INFO:teuthology.orchestra.run.smithi055.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 345 kB/s | 313 kB 00:00 2024-05-10T03:51:19.997 INFO:teuthology.orchestra.run.smithi064.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.5 MB/s | 2.4 MB 00:00 2024-05-10T03:51:20.000 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:51:20.000 INFO:teuthology.orchestra.run.smithi064.stdout:Total 12 MB/s | 226 MB 00:19 2024-05-10T03:51:20.204 INFO:teuthology.orchestra.run.smithi055.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-05-10T03:51:20.254 INFO:teuthology.orchestra.run.smithi055.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-05-10T03:51:20.371 INFO:teuthology.orchestra.run.smithi055.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-05-10T03:51:20.871 INFO:teuthology.orchestra.run.smithi055.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-05-10T03:51:21.013 INFO:teuthology.orchestra.run.smithi055.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 198 kB/s | 160 kB 00:00 2024-05-10T03:51:21.210 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-05-10T03:51:21.338 INFO:teuthology.orchestra.run.smithi055.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 685 kB/s | 662 kB 00:00 2024-05-10T03:51:21.376 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-05-10T03:51:21.376 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-05-10T03:51:21.622 INFO:teuthology.orchestra.run.smithi055.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-05-10T03:51:21.789 INFO:teuthology.orchestra.run.smithi055.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 635 kB/s | 582 kB 00:00 2024-05-10T03:51:21.981 INFO:teuthology.orchestra.run.smithi055.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-05-10T03:51:22.515 INFO:teuthology.orchestra.run.smithi055.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 328 kB/s | 292 kB 00:00 2024-05-10T03:51:22.581 INFO:teuthology.orchestra.run.smithi055.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 59 kB/s | 35 kB 00:00 2024-05-10T03:51:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 224 kB/s | 188 kB 00:00 2024-05-10T03:51:23.629 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-05-10T03:51:23.629 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-05-10T03:51:23.891 INFO:teuthology.orchestra.run.smithi055.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.4 MB/s | 4.7 MB 00:01 2024-05-10T03:51:23.949 INFO:teuthology.orchestra.run.smithi055.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2024-05-10T03:51:24.008 INFO:teuthology.orchestra.run.smithi055.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-05-10T03:51:24.758 INFO:teuthology.orchestra.run.smithi055.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 165 kB/s | 133 kB 00:00 2024-05-10T03:51:24.950 INFO:teuthology.orchestra.run.smithi055.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 862 kB/s | 911 kB 00:01 2024-05-10T03:51:25.284 INFO:teuthology.orchestra.run.smithi055.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-05-10T03:51:25.667 INFO:teuthology.orchestra.run.smithi055.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 122 kB/s | 87 kB 00:00 2024-05-10T03:51:25.784 INFO:teuthology.orchestra.run.smithi055.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-10T03:51:26.476 INFO:teuthology.orchestra.run.smithi055.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 302 kB/s | 244 kB 00:00 2024-05-10T03:51:26.560 INFO:teuthology.orchestra.run.smithi055.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-05-10T03:51:26.593 INFO:teuthology.orchestra.run.smithi055.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-05-10T03:51:27.119 INFO:teuthology.orchestra.run.smithi055.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 34 kB/s | 19 kB 00:00 2024-05-10T03:51:27.144 INFO:teuthology.orchestra.run.smithi055.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 38 kB/s | 26 kB 00:00 2024-05-10T03:51:27.428 INFO:teuthology.orchestra.run.smithi055.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 206 kB/s | 172 kB 00:00 2024-05-10T03:51:27.728 INFO:teuthology.orchestra.run.smithi055.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 57 kB/s | 35 kB 00:00 2024-05-10T03:51:28.262 INFO:teuthology.orchestra.run.smithi055.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 301 kB/s | 250 kB 00:00 2024-05-10T03:51:28.370 INFO:teuthology.orchestra.run.smithi055.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-10T03:51:28.545 INFO:teuthology.orchestra.run.smithi055.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-05-10T03:51:29.038 INFO:teuthology.orchestra.run.smithi055.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 99 kB/s | 77 kB 00:00 2024-05-10T03:51:29.062 INFO:teuthology.orchestra.run.smithi055.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 61 kB/s | 42 kB 00:00 2024-05-10T03:51:29.421 INFO:teuthology.orchestra.run.smithi055.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 317 kB/s | 269 kB 00:00 2024-05-10T03:51:29.797 INFO:teuthology.orchestra.run.smithi055.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 209 kB/s | 159 kB 00:00 2024-05-10T03:51:29.880 INFO:teuthology.orchestra.run.smithi055.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 341 kB/s | 279 kB 00:00 2024-05-10T03:51:30.080 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-05-10T03:51:30.080 INFO:teuthology.orchestra.run.smithi055.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-05-10T03:51:30.169 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T03:51:30.207 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T03:51:30.276 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T03:51:30.311 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T03:51:30.336 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T03:51:30.392 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T03:51:30.472 INFO:teuthology.orchestra.run.smithi055.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-05-10T03:51:30.689 INFO:teuthology.orchestra.run.smithi055.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-05-10T03:51:30.734 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T03:51:30.845 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-10T03:51:30.961 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-10T03:51:30.996 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-10T03:51:31.089 INFO:teuthology.orchestra.run.smithi055.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-05-10T03:51:31.093 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-10T03:51:31.126 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-10T03:51:31.308 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T03:51:31.357 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T03:51:31.384 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-10T03:51:31.457 INFO:teuthology.orchestra.run.smithi055.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-10T03:51:31.489 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-10T03:51:31.518 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-10T03:51:31.564 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-10T03:51:31.586 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T03:51:31.599 INFO:teuthology.orchestra.run.smithi055.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 243 kB/s | 221 kB 00:00 2024-05-10T03:51:31.611 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T03:51:31.755 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T03:51:31.890 INFO:teuthology.orchestra.run.smithi055.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 45 kB/s | 36 kB 00:00 2024-05-10T03:51:31.926 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T03:51:32.077 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T03:51:32.127 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T03:51:32.132 INFO:teuthology.orchestra.run.smithi055.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-05-10T03:51:32.240 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T03:51:32.320 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T03:51:32.466 INFO:teuthology.orchestra.run.smithi055.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 351 kB/s | 305 kB 00:00 2024-05-10T03:51:32.519 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T03:51:32.558 INFO:teuthology.orchestra.run.smithi055.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-05-10T03:51:32.629 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T03:51:32.658 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T03:51:32.692 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-10T03:51:32.775 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-10T03:51:32.817 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-10T03:51:32.860 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-10T03:51:32.883 INFO:teuthology.orchestra.run.smithi055.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 130 kB/s | 94 kB 00:00 2024-05-10T03:51:32.892 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-10T03:51:32.920 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-10T03:51:32.925 INFO:teuthology.orchestra.run.smithi055.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 544 kB/s | 22 kB 00:00 2024-05-10T03:51:32.991 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-10T03:51:33.025 INFO:teuthology.orchestra.run.smithi055.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-05-10T03:51:33.051 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-10T03:51:33.081 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-10T03:51:33.125 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-10T03:51:33.151 INFO:teuthology.orchestra.run.smithi055.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-05-10T03:51:33.203 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-10T03:51:33.244 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 32/164 2024-05-10T03:51:33.288 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 33/164 2024-05-10T03:51:33.293 INFO:teuthology.orchestra.run.smithi055.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 61 kB/s | 45 kB 00:00 2024-05-10T03:51:33.316 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 34/164 2024-05-10T03:51:33.351 INFO:teuthology.orchestra.run.smithi055.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-05-10T03:51:33.376 INFO:teuthology.orchestra.run.smithi055.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-05-10T03:51:33.387 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-10T03:51:33.402 INFO:teuthology.orchestra.run.smithi055.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 181 kB/s | 19 kB 00:00 2024-05-10T03:51:33.435 INFO:teuthology.orchestra.run.smithi055.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-05-10T03:51:33.439 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-10T03:51:33.502 INFO:teuthology.orchestra.run.smithi055.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-05-10T03:51:33.525 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-10T03:51:33.569 INFO:teuthology.orchestra.run.smithi055.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 509 kB/s | 67 kB 00:00 2024-05-10T03:51:33.661 INFO:teuthology.orchestra.run.smithi055.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-10T03:51:33.669 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-10T03:51:33.687 INFO:teuthology.orchestra.run.smithi055.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 826 kB/s | 151 kB 00:00 2024-05-10T03:51:33.720 INFO:teuthology.orchestra.run.smithi055.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-05-10T03:51:33.726 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-10T03:51:33.745 INFO:teuthology.orchestra.run.smithi055.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.6 MB/s | 548 kB 00:00 2024-05-10T03:51:33.771 INFO:teuthology.orchestra.run.smithi055.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 660 kB/s | 32 kB 00:00 2024-05-10T03:51:33.796 INFO:teuthology.orchestra.run.smithi055.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-05-10T03:51:33.821 INFO:teuthology.orchestra.run.smithi055.stdout:(117/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 437 kB/s | 43 kB 00:00 2024-05-10T03:51:33.847 INFO:teuthology.orchestra.run.smithi055.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-10T03:51:33.880 INFO:teuthology.orchestra.run.smithi055.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-10T03:51:33.905 INFO:teuthology.orchestra.run.smithi055.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-05-10T03:51:33.931 INFO:teuthology.orchestra.run.smithi055.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 428 kB/s | 35 kB 00:00 2024-05-10T03:51:34.023 INFO:teuthology.orchestra.run.smithi055.stdout:(122/156): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-05-10T03:51:34.056 INFO:teuthology.orchestra.run.smithi055.stdout:(123/156): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-05-10T03:51:34.082 INFO:teuthology.orchestra.run.smithi055.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 959 kB/s | 144 kB 00:00 2024-05-10T03:51:34.107 INFO:teuthology.orchestra.run.smithi055.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-05-10T03:51:34.132 INFO:teuthology.orchestra.run.smithi055.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-05-10T03:51:34.157 INFO:teuthology.orchestra.run.smithi055.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 308 kB/s | 23 kB 00:00 2024-05-10T03:51:34.183 INFO:teuthology.orchestra.run.smithi055.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-05-10T03:51:34.234 INFO:teuthology.orchestra.run.smithi055.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-05-10T03:51:34.258 INFO:teuthology.orchestra.run.smithi055.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-05-10T03:51:34.278 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-10T03:51:34.283 INFO:teuthology.orchestra.run.smithi055.stdout:(131/156): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2024-05-10T03:51:34.309 INFO:teuthology.orchestra.run.smithi055.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-10T03:51:34.334 INFO:teuthology.orchestra.run.smithi055.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 770 kB/s | 58 kB 00:00 2024-05-10T03:51:34.359 INFO:teuthology.orchestra.run.smithi055.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 330 kB/s | 16 kB 00:00 2024-05-10T03:51:34.364 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-10T03:51:34.400 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-10T03:51:34.442 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-10T03:51:34.480 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 44/164 2024-05-10T03:51:34.501 INFO:teuthology.orchestra.run.smithi055.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-05-10T03:51:34.523 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-10T03:51:34.526 INFO:teuthology.orchestra.run.smithi055.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 468 kB/s | 90 kB 00:00 2024-05-10T03:51:34.552 INFO:teuthology.orchestra.run.smithi055.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 147 kB/s | 28 kB 00:00 2024-05-10T03:51:34.577 INFO:teuthology.orchestra.run.smithi055.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-05-10T03:51:34.602 INFO:teuthology.orchestra.run.smithi055.stdout:(139/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-05-10T03:51:34.627 INFO:teuthology.orchestra.run.smithi055.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2024-05-10T03:51:34.652 INFO:teuthology.orchestra.run.smithi055.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 477 kB/s | 36 kB 00:00 2024-05-10T03:51:34.672 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-10T03:51:34.678 INFO:teuthology.orchestra.run.smithi055.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-10T03:51:34.703 INFO:teuthology.orchestra.run.smithi055.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-05-10T03:51:34.725 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-10T03:51:34.728 INFO:teuthology.orchestra.run.smithi055.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-10T03:51:34.754 INFO:teuthology.orchestra.run.smithi055.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-05-10T03:51:34.779 INFO:teuthology.orchestra.run.smithi055.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 270 kB/s | 20 kB 00:00 2024-05-10T03:51:34.812 INFO:teuthology.orchestra.run.smithi055.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-10T03:51:34.819 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-10T03:51:34.854 INFO:teuthology.orchestra.run.smithi055.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-05-10T03:51:34.890 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-10T03:51:34.964 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T03:51:35.001 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T03:51:35.046 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T03:51:35.094 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T03:51:35.129 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T03:51:35.172 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T03:51:35.197 INFO:teuthology.orchestra.run.smithi055.stdout:(149/156): librbd1-19.0.0-3538.gcd693b0b.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-05-10T03:51:35.222 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T03:51:35.364 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T03:51:35.403 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T03:51:35.434 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T03:51:35.475 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T03:51:35.572 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T03:51:35.608 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T03:51:35.649 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T03:51:35.688 INFO:teuthology.orchestra.run.smithi055.stdout:(150/156): librados2-19.0.0-3538.gcd693b0b.el9. 3.7 MB/s | 3.4 MB 00:00 2024-05-10T03:51:35.689 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T03:51:35.714 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T03:51:35.807 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T03:51:35.937 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T03:51:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T03:51:35.980 INFO:teuthology.orchestra.run.smithi055.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-05-10T03:51:36.009 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T03:51:36.043 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T03:51:36.082 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T03:51:36.121 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T03:51:36.151 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T03:51:36.185 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T03:51:36.219 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T03:51:36.261 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T03:51:36.264 INFO:teuthology.orchestra.run.smithi055.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-05-10T03:51:36.295 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T03:51:36.314 INFO:teuthology.orchestra.run.smithi055.stdout:(153/156): NetworkManager-team-1.47.5-1.el9.x86 67 kB/s | 42 kB 00:00 2024-05-10T03:51:36.385 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T03:51:36.435 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T03:51:36.465 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T03:51:36.513 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T03:51:36.622 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T03:51:36.684 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T03:51:36.807 INFO:teuthology.orchestra.run.smithi055.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 301 kB/s | 248 kB 00:00 2024-05-10T03:51:37.265 INFO:teuthology.orchestra.run.smithi055.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-10T03:51:37.415 INFO:teuthology.orchestra.run.smithi055.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-05-10T03:51:37.421 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-05-10T03:51:37.421 INFO:teuthology.orchestra.run.smithi055.stdout:Total 6.4 MB/s | 226 MB 00:35 2024-05-10T03:51:37.441 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T03:51:37.488 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T03:51:37.522 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T03:51:37.635 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T03:51:37.698 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T03:51:37.788 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T03:51:37.824 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T03:51:38.008 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T03:51:38.038 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T03:51:38.119 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T03:51:38.623 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-05-10T03:51:38.790 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-05-10T03:51:38.790 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-05-10T03:51:38.818 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T03:51:38.931 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T03:51:40.256 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T03:51:40.333 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T03:51:40.361 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T03:51:40.394 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T03:51:40.727 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T03:51:40.773 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-10T03:51:40.866 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-10T03:51:40.912 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 102/164 2024-05-10T03:51:40.948 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T03:51:41.034 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-05-10T03:51:41.034 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-05-10T03:51:41.453 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T03:51:41.476 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-10T03:51:41.548 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-10T03:51:41.578 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 106/164 2024-05-10T03:51:43.977 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-10T03:51:44.016 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-10T03:51:44.587 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-10T03:51:44.627 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-10T03:51:44.703 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-10T03:51:44.703 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T03:51:44.704 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T03:51:44.704 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:44.745 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-10T03:51:47.217 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-05-10T03:51:47.312 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T03:51:47.361 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T03:51:47.431 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T03:51:47.471 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T03:51:47.496 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T03:51:47.554 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T03:51:47.903 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T03:51:48.014 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-10T03:51:48.138 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-10T03:51:48.173 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-10T03:51:48.268 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-10T03:51:48.303 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-10T03:51:48.493 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T03:51:48.542 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T03:51:48.569 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-10T03:51:48.658 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-10T03:51:48.687 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-10T03:51:48.750 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 14/164 2024-05-10T03:51:48.771 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T03:51:48.798 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T03:51:48.982 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T03:51:49.161 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T03:51:49.294 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T03:51:49.354 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T03:51:49.458 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T03:51:49.530 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T03:51:49.733 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T03:51:49.848 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T03:51:49.881 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T03:51:49.920 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-10T03:51:49.997 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-10T03:51:50.037 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-10T03:51:50.080 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-10T03:51:50.113 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-10T03:51:50.140 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-10T03:51:50.204 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-10T03:51:50.255 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-10T03:51:50.285 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-10T03:51:50.329 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-10T03:51:50.408 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-10T03:51:50.439 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 32/164 2024-05-10T03:51:50.483 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 33/164 2024-05-10T03:51:50.511 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 34/164 2024-05-10T03:51:50.585 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-10T03:51:50.643 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-10T03:51:50.721 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-10T03:51:50.868 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-10T03:51:50.930 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-10T03:51:51.493 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-10T03:51:51.577 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-10T03:51:51.612 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-10T03:51:51.658 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-10T03:51:51.693 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 44/164 2024-05-10T03:51:51.736 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-10T03:51:51.888 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-10T03:51:51.946 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-10T03:51:52.042 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-10T03:51:52.103 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-10T03:51:52.178 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T03:51:52.222 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T03:51:52.259 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T03:51:52.306 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T03:51:52.350 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T03:51:52.394 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T03:51:52.436 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T03:51:52.579 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T03:51:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T03:51:52.654 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T03:51:52.696 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T03:51:52.795 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T03:51:52.838 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T03:51:52.880 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T03:51:52.911 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T03:51:52.944 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T03:51:53.036 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T03:51:53.168 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T03:51:53.201 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T03:51:53.234 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T03:51:53.265 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T03:51:53.304 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T03:51:53.343 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T03:51:53.373 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T03:51:53.407 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T03:51:53.441 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T03:51:53.483 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T03:51:53.625 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T03:51:53.715 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T03:51:53.765 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T03:51:53.795 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T03:51:53.843 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T03:51:53.954 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T03:51:54.015 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T03:51:54.788 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T03:51:54.836 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T03:51:54.869 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T03:51:54.975 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T03:51:55.037 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T03:51:55.128 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T03:51:55.182 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T03:51:55.366 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T03:51:55.394 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T03:51:55.475 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T03:51:56.175 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T03:51:56.288 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2024-05-10T03:51:56.422 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:56.616 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-10T03:51:56.633 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-10T03:51:56.633 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:51:56.633 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T03:51:56.633 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:57.818 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T03:51:58.031 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T03:51:58.051 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T03:51:58.076 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T03:51:58.177 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-10T03:51:58.205 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-10T03:51:58.205 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:51:58.205 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T03:51:58.205 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T03:51:58.206 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T03:51:58.206 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:58.406 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T03:51:58.444 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-10T03:51:58.446 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-10T03:51:58.469 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-10T03:51:58.469 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:51:58.469 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T03:51:58.469 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T03:51:58.470 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T03:51:58.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:58.539 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 101/164 2024-05-10T03:51:58.568 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 102/164 2024-05-10T03:51:58.605 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T03:51:58.937 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-10T03:51:58.961 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-10T03:51:58.961 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:51:58.961 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T03:51:58.961 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T03:51:58.961 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T03:51:58.961 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:51:59.067 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T03:51:59.111 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T03:51:59.125 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T03:51:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-10T03:51:59.190 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T03:51:59.213 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 105/164 2024-05-10T03:51:59.243 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 106/164 2024-05-10T03:51:59.387 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T03:51:59.440 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T03:51:59.520 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T03:51:59.618 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T03:51:59.760 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T03:51:59.807 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T03:51:59.838 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T03:51:59.865 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T03:52:00.221 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-10T03:52:00.250 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-10T03:52:00.280 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 126/164 2024-05-10T03:52:00.343 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 127/164 2024-05-10T03:52:00.370 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-10T03:52:01.464 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-10T03:52:01.497 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-10T03:52:01.616 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-10T03:52:01.649 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-10T03:52:02.222 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 107/164 2024-05-10T03:52:02.261 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-10T03:52:02.354 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 108/164 2024-05-10T03:52:02.354 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T03:52:02.355 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T03:52:02.355 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:02.395 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-10T03:52:02.509 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-10T03:52:02.530 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-10T03:52:02.648 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-10T03:52:02.824 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 131/164 2024-05-10T03:52:02.858 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-10T03:52:02.883 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-10T03:52:02.883 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:02.883 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T03:52:02.883 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T03:52:02.883 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T03:52:02.883 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:02.934 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-10T03:52:02.945 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-10T03:52:03.046 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 134/164 2024-05-10T03:52:03.104 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 135/164 2024-05-10T03:52:04.085 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T03:52:04.111 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-10T03:52:04.136 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-10T03:52:04.136 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:04.136 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T03:52:04.136 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T03:52:04.136 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T03:52:04.136 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:04.178 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-10T03:52:04.202 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-10T03:52:04.202 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:04.202 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T03:52:04.203 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:04.254 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-10T03:52:04.278 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-10T03:52:04.278 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:04.278 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T03:52:04.278 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T03:52:04.278 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T03:52:04.279 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:04.596 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-10T03:52:04.621 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-10T03:52:04.621 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:04.621 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T03:52:04.621 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T03:52:04.621 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T03:52:04.621 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:09.500 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 141/164 2024-05-10T03:52:09.551 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 142/164 2024-05-10T03:52:09.591 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 143/164 2024-05-10T03:52:09.623 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T03:52:09.650 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T03:52:09.856 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 146/164 2024-05-10T03:52:09.904 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T03:52:09.926 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 148/164 2024-05-10T03:52:09.956 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T03:52:10.002 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T03:52:10.607 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T03:52:10.666 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T03:52:10.686 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T03:52:11.594 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 152/164 2024-05-10T03:52:11.696 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T03:52:11.775 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T03:52:11.864 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T03:52:11.907 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T03:52:11.933 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T03:52:11.933 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T03:52:12.017 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T03:52:12.050 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T03:52:12.050 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T03:52:12.143 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T03:52:12.168 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T03:52:12.174 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T03:52:12.174 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T03:52:12.365 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T03:52:12.365 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T03:52:12.463 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T03:52:12.539 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T03:52:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 109/164 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-05-10T03:52:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:14.695 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-10T03:52:14.711 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 110/164 2024-05-10T03:52:14.711 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:14.711 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T03:52:14.711 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:16.275 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-10T03:52:16.303 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 111/164 2024-05-10T03:52:16.303 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:16.303 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T03:52:16.303 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T03:52:16.303 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T03:52:16.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:16.551 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-10T03:52:16.575 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 112/164 2024-05-10T03:52:16.576 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:16.576 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T03:52:16.576 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T03:52:16.576 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T03:52:16.576 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:17.043 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-10T03:52:17.068 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 113/164 2024-05-10T03:52:17.068 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:17.068 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T03:52:17.068 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T03:52:17.068 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T03:52:17.068 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:17.174 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T03:52:17.233 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T03:52:17.297 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T03:52:17.494 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T03:52:17.537 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T03:52:17.619 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T03:52:17.717 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T03:52:17.879 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T03:52:17.921 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T03:52:17.953 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T03:52:17.988 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T03:52:18.103 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T03:52:18.103 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 1/164 2024-05-10T03:52:18.103 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2/164 2024-05-10T03:52:18.103 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 3/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 4/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 5/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 6/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 7/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 11/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 12/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 14/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 15/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 16/164 2024-05-10T03:52:18.104 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 17/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 18/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 19/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 20/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 21/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 22/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 23/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 24/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 25/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 26/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 27/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 28/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 29/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 30/164 2024-05-10T03:52:18.105 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 31/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 32/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 33/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 34/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 35/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 36/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 37/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 38/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 39/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T03:52:18.106 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T03:52:18.107 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T03:52:18.108 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T03:52:18.109 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T03:52:18.110 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T03:52:18.111 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T03:52:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T03:52:18.113 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 149/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 151/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T03:52:18.114 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T03:52:18.115 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T03:52:18.115 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T03:52:18.419 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-10T03:52:18.446 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 125/164 2024-05-10T03:52:18.479 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 126/164 2024-05-10T03:52:18.543 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 127/164 2024-05-10T03:52:18.598 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-10T03:52:19.700 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 128/164 2024-05-10T03:52:19.738 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-10T03:52:20.755 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 129/164 2024-05-10T03:52:20.788 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-10T03:52:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T03:52:20.862 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T03:52:20.863 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.864 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T03:52:20.865 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T03:52:20.866 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T03:52:20.867 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T03:52:20.868 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T03:52:20.869 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T03:52:20.870 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T03:52:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T03:52:20.872 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T03:52:20.873 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:20.874 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-05-10T03:52:20.908 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 130/164 2024-05-10T03:52:21.082 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 131/164 2024-05-10T03:52:21.116 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-10T03:52:21.141 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 132/164 2024-05-10T03:52:21.141 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:21.141 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T03:52:21.141 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T03:52:21.141 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T03:52:21.141 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:21.192 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-10T03:52:21.204 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 133/164 2024-05-10T03:52:21.305 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 134/164 2024-05-10T03:52:21.317 DEBUG:teuthology.parallel:result is None 2024-05-10T03:52:21.368 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 135/164 2024-05-10T03:52:22.353 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T03:52:22.386 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-10T03:52:22.411 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 137/164 2024-05-10T03:52:22.411 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:22.411 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T03:52:22.411 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T03:52:22.411 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T03:52:22.412 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:22.453 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-10T03:52:22.477 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gcd693 138/164 2024-05-10T03:52:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:22.477 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T03:52:22.477 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:22.538 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-10T03:52:22.562 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 139/164 2024-05-10T03:52:22.562 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:22.562 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T03:52:22.563 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T03:52:22.563 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T03:52:22.563 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:22.889 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-10T03:52:22.913 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 140/164 2024-05-10T03:52:22.913 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T03:52:22.913 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T03:52:22.913 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T03:52:22.913 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T03:52:22.913 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:27.810 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 141/164 2024-05-10T03:52:27.852 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 142/164 2024-05-10T03:52:27.894 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 143/164 2024-05-10T03:52:27.925 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T03:52:27.952 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T03:52:28.164 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 146/164 2024-05-10T03:52:28.215 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T03:52:28.245 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 148/164 2024-05-10T03:52:28.275 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T03:52:28.322 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T03:52:28.923 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T03:52:28.962 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T03:52:28.983 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T03:52:29.910 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 152/164 2024-05-10T03:52:30.010 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T03:52:30.063 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T03:52:30.163 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T03:52:30.197 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T03:52:30.223 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T03:52:30.223 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T03:52:30.333 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T03:52:30.366 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T03:52:30.366 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T03:52:30.434 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T03:52:30.459 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T03:52:30.465 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T03:52:30.465 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T03:52:30.662 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T03:52:30.662 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T03:52:30.746 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T03:52:30.822 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T03:52:36.514 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T03:52:36.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 1/164 2024-05-10T03:52:36.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2/164 2024-05-10T03:52:36.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 3/164 2024-05-10T03:52:36.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 4/164 2024-05-10T03:52:36.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gcd693 5/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 6/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 7/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 8/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 9/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 10/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 11/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 12/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 13/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 14/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_ 15/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 16/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 17/164 2024-05-10T03:52:36.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_6 18/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86 19/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 20/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el 21/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9. 22/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_6 23/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 24/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 25/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 26/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 27/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 28/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 29/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b. 30/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noa 31/164 2024-05-10T03:52:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.n 32/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd6 33/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el 34/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 35/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.e 36/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 37/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 38/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 39/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T03:52:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T03:52:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T03:52:36.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T03:52:36.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T03:52:36.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T03:52:36.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T03:52:36.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T03:52:36.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T03:52:36.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T03:52:36.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T03:52:36.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T03:52:36.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 149/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 151/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T03:52:36.529 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T03:52:36.530 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T03:52:36.530 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T03:52:36.530 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T03:52:39.253 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T03:52:39.254 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.255 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.256 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.257 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:19.0.0-3538.gcd693b0b.el9.noarch 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T03:52:39.258 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T03:52:39.259 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T03:52:39.260 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T03:52:39.261 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T03:52:39.262 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T03:52:39.263 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T03:52:39.264 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.265 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T03:52:39.266 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:19.0.0-3538.gcd693b0b.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T03:52:39.267 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T03:52:39.268 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T03:52:39.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:39.268 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-05-10T03:52:39.717 DEBUG:teuthology.parallel:result is None 2024-05-10T03:52:39.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-10T03:52:39.861 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T03:52:39.885 INFO:teuthology.orchestra.run.smithi055.stdout:19.0.0-3538.gcd693b0b.el9 2024-05-10T03:52:39.886 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gcd693b0b.el9 2024-05-10T03:52:39.886 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gcd693b0b is installed. 2024-05-10T03:52:39.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd693b0b93278c2b128be2d6d93ae4df18c3ba1c 2024-05-10T03:52:40.030 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T03:52:40.058 INFO:teuthology.orchestra.run.smithi064.stdout:19.0.0-3538.gcd693b0b.el9 2024-05-10T03:52:40.058 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gcd693b0b.el9 2024-05-10T03:52:40.058 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gcd693b0b is installed. 2024-05-10T03:52:40.060 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T03:52:40.060 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:40.061 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T03:52:40.090 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:40.090 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T03:52:40.132 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T03:52:40.132 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:40.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T03:52:40.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T03:52:40.226 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:40.226 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T03:52:40.257 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T03:52:40.328 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T03:52:40.328 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:40.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T03:52:40.355 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T03:52:40.422 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:40.422 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T03:52:40.456 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T03:52:40.526 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T03:52:40.526 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:40.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T03:52:40.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T03:52:40.621 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:40.621 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T03:52:40.647 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T03:52:40.713 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T03:52:40.913 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T03:52:40.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2024-05-10T03:52:40.917 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /var/log/ceph 2024-05-10T03:52:40.943 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T03:52:40.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T03:52:40.986 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T03:52:41.013 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T03:52:41.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T03:52:41.056 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T03:52:41.089 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-10T03:52:41.090 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-10T03:52:41.112 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-10T03:52:41.113 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:41.113 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T03:52:41.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T03:52:41.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T03:52:41.280 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:41.281 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T03:52:41.298 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T03:52:41.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T03:52:41.442 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T03:52:41.442 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T03:52:41.442 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660', 'branch': 'wip-jcollin-testing-07052024', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'job_id': '7700660', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-jcollin-testing-07052024'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'origin-jcollin-testing', 'sha1': '1ef17e831a1b0a2132aa514927b7748adaf73171'}}, 'owner': 'scheduled_jcollin@teuthology', 'priority': 2, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9809, 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'origin-jcollin-testing', 'suite_path': '/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/joscollin/ceph.git', 'suite_sha1': '1ef17e831a1b0a2132aa514927b7748adaf73171', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7FdJqdCHwolGpq9tqq5sqt4A6W4cTa2wZdqVnN5Qhtb8LuMx74etxifhyELUMWKVrob5sHcn+JJFd7R3XeRS8=', 'smithi064.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUGkTzYTWonc2cRDiutYhQBE8zNNzT2G6by0wxOOXpcaq4LiY+1urCib9rfIC2+PQ+1pqBjXL3HW4Bd3chenys='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'cd693b0b93278c2b128be2d6d93ae4df18c3ba1c', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_03:34:35', 'tube': 'smithi', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T03:52:41.443 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T03:52:41.445 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T03:52:41.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T03:52:41.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T03:52:41.558 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:41.558 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T03:52:41.590 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T03:52:41.590 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-05-10T03:52:41.650 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T03:52:41.650 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:41.650 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-10T03:52:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-10 03:52:31.178073573 +0000 2024-05-10T03:52:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-10 03:50:14.432471855 +0000 2024-05-10T03:52:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-10 03:50:14.432471855 +0000 2024-05-10T03:52:41.651 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-10 03:50:14.432471855 +0000 2024-05-10T03:52:41.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T03:52:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-10T03:52:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-10T03:52:41.719 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000394802 s, 1.3 MB/s 2024-05-10T03:52:41.720 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T03:52:41.780 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-10 03:52:31.178073573 +0000 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-10 03:50:14.795464925 +0000 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-10 03:50:14.795464925 +0000 2024-05-10T03:52:41.839 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-10 03:50:14.795464925 +0000 2024-05-10T03:52:41.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T03:52:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-10T03:52:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-10T03:52:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000291764 s, 1.8 MB/s 2024-05-10T03:52:41.909 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T03:52:41.968 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-05-10T03:52:42.027 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T03:52:42.027 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:42.027 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-10T03:52:42.027 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:42.028 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:42.028 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-10 03:52:31.179073554 +0000 2024-05-10T03:52:42.028 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-10 03:50:15.155458052 +0000 2024-05-10T03:52:42.028 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-10 03:50:15.155458052 +0000 2024-05-10T03:52:42.028 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-10 03:50:15.155458052 +0000 2024-05-10T03:52:42.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T03:52:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-10T03:52:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-10T03:52:42.097 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000297446 s, 1.7 MB/s 2024-05-10T03:52:42.099 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T03:52:42.159 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-10 03:52:31.179073554 +0000 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-10 03:50:15.513451218 +0000 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-10 03:50:15.513451218 +0000 2024-05-10T03:52:42.219 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-10 03:50:15.513451218 +0000 2024-05-10T03:52:42.220 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T03:52:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-10T03:52:42.289 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-10T03:52:42.289 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000282276 s, 1.8 MB/s 2024-05-10T03:52:42.290 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T03:52:42.350 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T03:52:42.350 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:42.351 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T03:52:42.371 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T03:52:42.371 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-05-10 03:52:12.901557207 +0000 2024-05-10T03:52:42.431 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-05-10 03:50:14.433281877 +0000 2024-05-10T03:52:42.432 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-05-10 03:50:14.433281877 +0000 2024-05-10T03:52:42.432 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-05-10 03:50:14.433281877 +0000 2024-05-10T03:52:42.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T03:52:42.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-05-10T03:52:42.503 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-05-10T03:52:42.503 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.0002212 s, 2.3 MB/s 2024-05-10T03:52:42.505 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T03:52:42.564 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-05-10 03:52:12.901557207 +0000 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-05-10 03:50:14.798274591 +0000 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-05-10 03:50:14.798274591 +0000 2024-05-10T03:52:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-05-10 03:50:14.798274591 +0000 2024-05-10T03:52:42.624 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T03:52:42.692 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-05-10T03:52:42.692 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-05-10T03:52:42.692 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000201668 s, 2.5 MB/s 2024-05-10T03:52:42.694 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T03:52:42.753 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-05-10 03:52:12.901557207 +0000 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-05-10 03:50:15.156267445 +0000 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-05-10 03:50:15.156267445 +0000 2024-05-10T03:52:42.811 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-05-10 03:50:15.156267445 +0000 2024-05-10T03:52:42.811 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T03:52:42.878 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-05-10T03:52:42.878 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-05-10T03:52:42.879 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000218542 s, 2.3 MB/s 2024-05-10T03:52:42.880 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T03:52:42.938 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-05-10 03:52:12.902557187 +0000 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-05-10 03:50:15.493260718 +0000 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-05-10 03:50:15.493260718 +0000 2024-05-10T03:52:42.997 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-05-10 03:50:15.493260718 +0000 2024-05-10T03:52:42.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T03:52:43.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-05-10T03:52:43.063 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-05-10T03:52:43.063 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000189606 s, 2.7 MB/s 2024-05-10T03:52:43.064 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T03:52:43.123 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T03:52:43.123 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T03:52:43.123 INFO:tasks.ceph:Generating config... 2024-05-10T03:52:43.127 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-10T03:52:43.127 INFO:tasks.ceph:[client] debug client = 20 2024-05-10T03:52:43.127 INFO:tasks.ceph:[client] debug ms = 1 2024-05-10T03:52:43.127 INFO:tasks.ceph:[client] pid file = 2024-05-10T03:52:43.127 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-10T03:52:43.127 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-10T03:52:43.127 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-10T03:52:43.127 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-10T03:52:43.127 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-10T03:52:43.127 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-10T03:52:43.127 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-10T03:52:43.127 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-10T03:52:43.128 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-10T03:52:43.128 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-10T03:52:43.128 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T03:52:43.129 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-10T03:52:43.130 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T03:52:43.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T03:52:43.191 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T03:52:43.194 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T03:52:43.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T03:52:43.269 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.64'), ('mon.c', '[v2:172.21.15.64:3301,v1:172.21.15.64:6790]')] 2024-05-10T03:52:43.269 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-10T03:52:43.270 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:43.270 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T03:52:43.326 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.64 --addv c '[v2:172.21.15.64:3301,v1:172.21.15.64:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:43.414 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid 799093e3-fb07-47b3-97e4-8d13003c3bca 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = quincy 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:fsid 799093e3-fb07-47b3-97e4-8d13003c3bca 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2024-05-10T03:52:43.413059+0000 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-05-10T03:52:43.413059+0000 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 17 (quincy) 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] mon.c 2024-05-10T03:52:43.415 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T03:52:43.417 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T03:52:43.432 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 799093e3-fb07-47b3-97e4-8d13003c3bca... 2024-05-10T03:52:43.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T03:52:43.475 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T03:52:43.518 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-05-10T03:52:43.518 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-05-10T03:52:43.518 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T03:52:43.518 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-05-10T03:52:43.518 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.518 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.519 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T03:52:43.520 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]" 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 799093e3-fb07-47b3-97e4-8d13003c3bca 2024-05-10T03:52:43.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-05-10T03:52:43.522 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-05-10T03:52:43.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-05-10T03:52:43.524 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-10T03:52:43.525 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-05-10T03:52:43.526 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-05-10T03:52:43.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon down mkfs grace = 300 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-05-10T03:52:43.528 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-05-10T03:52:43.529 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-05-10T03:52:43.530 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-05-10T03:52:43.530 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-05-10T03:52:43.530 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-05-10T03:52:43.530 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-05-10T03:52:43.530 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T03:52:43.530 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T03:52:43.531 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.532 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.55,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]" 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = 799093e3-fb07-47b3-97e4-8d13003c3bca 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.533 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-05-10T03:52:43.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: bdev async discard = True 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: bdev enable discard = True 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore allocator = bitmap 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-05-10T03:52:43.535 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 1/20 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 1/20 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 4/10 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-05-10T03:52:43.536 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug client = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-05-10T03:52:43.537 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-05-10T03:52:43.538 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: mon op complaint time = 120 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: client mount timeout = 600 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: debug client = 20 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2024-05-10T03:52:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds = 20 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds balancer = 20 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug frag = True 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = True 2024-05-10T03:52:43.540 INFO:teuthology.orchestra.run.smithi064.stdout: mds op complaint time = 180 2024-05-10T03:52:43.541 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = True 2024-05-10T03:52:43.541 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2024-05-10T03:52:43.541 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2024-05-10T03:52:43.541 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2024-05-10T03:52:43.543 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T03:52:43.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T03:52:43.638 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T03:52:43.639 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:43.639 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T03:52:43.654 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:43.654 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T03:52:43.710 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:52:43.710 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:43.710 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T03:52:43.710 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T03:52:43.786 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:52:43.786 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:43.843 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:52:43.843 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:43.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T03:52:43.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T03:52:43.886 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:52:43.887 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:43.945 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T03:52:43.946 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T03:52:43.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T03:52:43.999 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T03:52:44.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T03:52:44.075 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T03:52:44.077 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T03:52:44.078 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T03:52:44.131 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T03:52:44.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-10T03:52:44.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T03:52:44.254 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T03:52:44.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-10T03:52:44.282 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T03:52:44.340 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T03:52:44.343 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-10T03:52:44.370 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T03:52:44.465 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T03:52:44.468 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-10T03:52:44.493 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T03:52:44.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T03:52:44.538 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T03:52:44.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-10T03:52:44.594 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-10T03:52:44.607 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T03:52:44.649 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T03:52:44.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-10T03:52:44.745 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-10T03:52:44.758 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T03:52:44.758 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T03:52:44.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T03:52:44.785 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T03:52:44.785 INFO:tasks.ceph:role: osd.0 2024-05-10T03:52:44.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:52:44.785 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T03:52:44.878 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:52:44.879 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:52:46.221 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-10T03:52:46.223 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-10T03:52:46.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T03:52:46.261 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T03:52:46.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T03:52:46.405 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T03:52:46.405 INFO:tasks.ceph:role: osd.1 2024-05-10T03:52:46.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:52:46.405 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T03:52:46.501 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:52:46.501 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:52:46.501 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:52:46.502 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:52:47.837 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-10T03:52:47.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-10T03:52:47.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T03:52:47.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T03:52:47.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T03:52:48.009 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T03:52:48.009 INFO:tasks.ceph:role: osd.2 2024-05-10T03:52:48.009 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:52:48.009 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:52:48.103 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:52:49.444 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-10T03:52:49.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-10T03:52:49.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T03:52:49.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T03:52:49.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T03:52:49.593 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T03:52:49.593 INFO:tasks.ceph:role: osd.3 2024-05-10T03:52:49.593 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:52:49.593 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T03:52:49.688 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:52:49.688 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:52:49.688 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:52:49.688 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:52:49.688 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:52:49.689 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:52:49.689 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:52:49.689 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:52:49.689 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:52:49.689 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:52:51.010 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-10T03:52:51.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-10T03:52:51.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T03:52:51.051 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T03:52:51.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:51.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:51.231+0000 7f94c8f3b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T03:52:51.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:51.231+0000 7f94c8f3b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T03:52:51.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:51.231+0000 7f94c8f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T03:52:51.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:51.231+0000 7f94c8f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T03:52:51.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:51.231+0000 7f94c8f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T03:52:51.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:51.232+0000 7f94c8f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T03:52:54.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T03:52:54.142 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:54.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:54.233+0000 7fad4eba7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T03:52:54.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:54.233+0000 7fad4eba7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T03:52:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:54.233+0000 7fad4eba7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T03:52:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:54.233+0000 7fad4eba7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T03:52:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:54.233+0000 7fad4eba7640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T03:52:54.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:54.234+0000 7fad4eba7640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T03:52:57.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T03:52:57.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:52:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:57.230+0000 7fcf02a1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T03:52:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:57.230+0000 7fcf02a1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T03:52:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:57.230+0000 7fcf02a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T03:52:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:57.230+0000 7fcf02a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T03:52:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:57.230+0000 7fcf02a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T03:52:57.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:52:57.231+0000 7fcf02a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T03:53:00.103 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T03:53:00.134 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:00.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:00.224+0000 7f693dc9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T03:53:00.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:00.225+0000 7f693dc9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T03:53:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:00.225+0000 7f693dc9d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T03:53:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:00.225+0000 7f693dc9d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T03:53:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:00.225+0000 7f693dc9d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T03:53:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:00.225+0000 7f693dc9d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T03:53:03.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T03:53:03.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T03:53:03.171 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T03:53:03.171 INFO:tasks.ceph:role: osd.4 2024-05-10T03:53:03.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:53:03.171 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T03:53:03.249 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:53:03.249 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:53:03.249 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:53:03.250 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:53:03.763 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-05-10T03:53:03.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-05-10T03:53:03.766 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T03:53:03.902 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T03:53:03.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T03:53:04.005 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T03:53:04.005 INFO:tasks.ceph:role: osd.5 2024-05-10T03:53:04.005 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:53:04.006 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:53:04.081 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:53:04.530 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-05-10T03:53:04.533 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-05-10T03:53:04.533 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T03:53:04.631 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T03:53:04.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T03:53:04.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T03:53:04.732 INFO:tasks.ceph:role: osd.6 2024-05-10T03:53:04.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:53:04.732 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T03:53:04.806 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:53:04.806 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:53:04.806 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:53:04.806 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:53:04.806 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:53:04.806 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:53:04.807 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:53:04.807 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:53:04.807 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:53:04.807 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:53:05.298 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-05-10T03:53:05.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-05-10T03:53:05.300 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T03:53:05.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T03:53:05.499 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T03:53:05.567 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T03:53:05.568 INFO:tasks.ceph:role: osd.7 2024-05-10T03:53:05.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:53:05.568 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T03:53:05.643 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T03:53:05.644 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T03:53:06.134 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-05-10T03:53:06.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-05-10T03:53:06.137 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T03:53:06.289 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T03:53:06.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:06.429+0000 7f4e4de15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T03:53:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:06.429+0000 7f4e4de15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T03:53:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:06.429+0000 7f4e4de15640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T03:53:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:06.429+0000 7f4e4de15640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T03:53:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:06.429+0000 7f4e4de15640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T03:53:06.435 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:06.430+0000 7f4e4de15640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T03:53:09.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T03:53:09.318 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:09.408+0000 7fd02f81a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T03:53:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:09.408+0000 7fd02f81a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T03:53:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:09.408+0000 7fd02f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T03:53:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:09.408+0000 7fd02f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T03:53:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:09.408+0000 7fd02f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T03:53:09.412 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:09.409+0000 7fd02f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T03:53:11.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:53:11.447 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:53:12.275 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T03:53:12.306 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:12.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:12.395+0000 7f6c61218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T03:53:12.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:12.395+0000 7f6c61218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T03:53:12.398 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:12.395+0000 7f6c61218640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T03:53:12.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:12.395+0000 7f6c61218640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T03:53:12.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:12.395+0000 7f6c61218640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T03:53:12.399 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:12.396+0000 7f6c61218640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T03:53:15.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T03:53:15.285 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:15.374+0000 7f919e615640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T03:53:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:15.374+0000 7f919e615640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T03:53:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:15.375+0000 7f919e615640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T03:53:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:15.375+0000 7f919e615640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T03:53:15.378 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:15.375+0000 7f919e615640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T03:53:15.379 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:15.375+0000 7f919e615640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T03:53:18.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T03:53:18.263 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T03:53:18.263 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T03:53:18.294 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-10T03:53:18.364 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-10T03:53:18.434 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T03:53:18.502 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T03:53:18.571 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T03:53:18.639 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:18.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T03:53:18.706 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:18.707 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T03:53:18.738 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:18.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-10T03:53:18.809 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:18.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-10T03:53:18.879 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:18.879 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T03:53:18.947 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:18.947 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T03:53:19.014 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:19.014 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T03:53:19.081 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:19.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T03:53:19.149 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:19.149 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T03:53:19.167 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:19.167 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-10T03:53:19.225 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:19.226 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T03:53:19.243 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:19.243 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-10T03:53:19.300 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T03:53:19.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T03:53:19.303 DEBUG:teuthology.orchestra.run.smithi064:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T03:53:19.345 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2024-05-10T03:53:19.345 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQALmj1mlEFyOxAA+zR7KPskG6BW+lijjptHwg== 2024-05-10T03:53:19.345 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-05-10T03:53:19.345 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1mzxy7BxAAY2dL925JVAS/+ZCl6OKPgA== 2024-05-10T03:53:19.345 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-05-10T03:53:19.346 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1moFAPDxAA/C8V8fr8Rf/vW10SRpLxIg== 2024-05-10T03:53:19.346 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2024-05-10T03:53:19.346 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQATmj1mkKDXDRAAMArE+5U8EDDHFLoMNAnCTA== 2024-05-10T03:53:19.346 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2024-05-10T03:53:19.346 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAWmj1m/dryDRAAmGUWXsLMVm6OYMZQ+7HK+Q== 2024-05-10T03:53:19.346 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2024-05-10T03:53:19.347 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAZmj1mT7/CDRAAbayfjejxrqzmuLNa4iFczw== 2024-05-10T03:53:19.347 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2024-05-10T03:53:19.347 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAcmj1mghd0DRAAOJIq1/TorjYtLFBUPG5MjA== 2024-05-10T03:53:19.347 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2024-05-10T03:53:19.347 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1mhVtfBBAAO536wo2uSIfTmI2iEwY51A== 2024-05-10T03:53:19.347 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-05-10T03:53:19.348 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1mN5I2FBAAMCWI/cQsF/3Qm1Rj3PA/gg== 2024-05-10T03:53:19.348 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-05-10T03:53:19.348 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1mto+qGxAAalU+JMiTMsfDkIEckuRdSw== 2024-05-10T03:53:19.348 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2024-05-10T03:53:19.348 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAimj1m1sOqGRAAPdCJjatdUG/OKdW/3vy6KQ== 2024-05-10T03:53:19.348 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2024-05-10T03:53:19.349 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAlmj1m7KFoGBAAJVSg+dlhEIdKFhYM3S0y4g== 2024-05-10T03:53:19.349 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2024-05-10T03:53:19.349 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAomj1mtfOiFxAA21Pjqv6zT3WUEaxALsp8BA== 2024-05-10T03:53:19.349 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2024-05-10T03:53:19.349 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQArmj1m8U1nFhAA0+zOd4scNmuxMqHptmP1uw== 2024-05-10T03:53:19.350 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-05-10T03:53:19.350 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1ml0IAIBAA93lk8/YccGFOF3TeM3QGRw== 2024-05-10T03:53:19.350 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2024-05-10T03:53:19.350 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1m4iJRIxAAFaJZvJnNefYwuMOdFDkh1w== 2024-05-10T03:53:19.350 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2024-05-10T03:53:19.350 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1molWkJhAAQalj3qj0hmSf1BWAng0mJw== 2024-05-10T03:53:19.351 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2024-05-10T03:53:19.351 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1miNZQLBAAAWhWNARxpP1VQuSUxu8gqg== 2024-05-10T03:53:19.366 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.y] 2024-05-10T03:53:19.366 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQALmj1mlEFyOxAA+zR7KPskG6BW+lijjptHwg== 2024-05-10T03:53:19.366 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-05-10T03:53:19.366 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1mzxy7BxAAY2dL925JVAS/+ZCl6OKPgA== 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1moFAPDxAA/C8V8fr8Rf/vW10SRpLxIg== 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.0] 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQATmj1mkKDXDRAAMArE+5U8EDDHFLoMNAnCTA== 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.1] 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAWmj1m/dryDRAAmGUWXsLMVm6OYMZQ+7HK+Q== 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.2] 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAZmj1mT7/CDRAAbayfjejxrqzmuLNa4iFczw== 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.3] 2024-05-10T03:53:19.367 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAcmj1mghd0DRAAOJIq1/TorjYtLFBUPG5MjA== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.x] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1mhVtfBBAAO536wo2uSIfTmI2iEwY51A== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1mN5I2FBAAMCWI/cQsF/3Qm1Rj3PA/gg== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1mto+qGxAAalU+JMiTMsfDkIEckuRdSw== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.4] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAimj1m1sOqGRAAPdCJjatdUG/OKdW/3vy6KQ== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.5] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAlmj1m7KFoGBAAJVSg+dlhEIdKFhYM3S0y4g== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.6] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAomj1mtfOiFxAA21Pjqv6zT3WUEaxALsp8BA== 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.7] 2024-05-10T03:53:19.368 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQArmj1m8U1nFhAA0+zOd4scNmuxMqHptmP1uw== 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1ml0IAIBAA93lk8/YccGFOF3TeM3QGRw== 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout:[client.2] 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1m4iJRIxAAFaJZvJnNefYwuMOdFDkh1w== 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout:[client.1] 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1molWkJhAAQalj3qj0hmSf1BWAng0mJw== 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout:[client.3] 2024-05-10T03:53:19.369 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQAMmj1miNZQLBAAAWhWNARxpP1VQuSUxu8gqg== 2024-05-10T03:53:19.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T03:53:19.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T03:53:19.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.468 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.584 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.639 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.691 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.748 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.750 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T03:53:19.804 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T03:53:19.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.917 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T03:53:19.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:19.975 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.030 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.082 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.084 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.136 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.139 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T03:53:20.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.252 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.310 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.368 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T03:53:20.423 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T03:53:20.424 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T03:53:20.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T03:53:20.566 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T03:53:20.592 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T03:53:20.618 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T03:53:20.717 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T03:53:20.743 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T03:53:20.810 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T03:53:20.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T03:53:20.933 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:20.935 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T03:53:20.990 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T03:53:20.991 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T03:53:20.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T03:53:20.994 INFO:tasks.ceph.mon.a:Started 2024-05-10T03:53:20.994 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T03:53:20.994 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T03:53:21.033 INFO:tasks.ceph.mon.b:Started 2024-05-10T03:53:21.034 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T03:53:21.034 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T03:53:21.036 INFO:tasks.ceph.mon.c:Started 2024-05-10T03:53:21.036 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T03:53:21.036 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T03:53:21.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T03:53:21.040 INFO:tasks.ceph.mgr.y:Started 2024-05-10T03:53:21.041 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T03:53:21.041 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T03:53:21.043 INFO:tasks.ceph.mgr.x:Started 2024-05-10T03:53:21.043 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T03:53:21.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T03:53:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.143+0000 7ff9d357f640 1 Processor -- start 2024-05-10T03:53:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.144+0000 7ff9d357f640 1 -- start start 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.144+0000 7ff9d357f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 0x7ff9cc0d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.144+0000 7ff9d357f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 0x7ff9cc0d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.144+0000 7ff9d357f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9cc0d3c60 con 0x7ff9cc15f250 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.144+0000 7ff9d357f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc0d3f40 con 0x7ff9cc15f630 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.144+0000 7ff9d357f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc0d4220 con 0x7ff9cc0b7480 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 0x7ff9cc0d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 0x7ff9cc0d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60490/0 (socket says 172.21.15.55:60490) 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/900458309 learned_addr learned my addr 172.21.15.55:0/900458309 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/900458309 >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 msgr2=0x7ff9cc0d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/900458309 >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 msgr2=0x7ff9cc0d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T03:53:21.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 0x7ff9cc0d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T03:53:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 0x7ff9cc0d4d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:53:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d0b1a640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 0x7ff9cc0d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d0b1a640 1 -- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 msgr2=0x7ff9cc0d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T03:53:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d0b1a640 1 -- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 msgr2=0x7ff9cc0d35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T03:53:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d0b1a640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 0x7ff9cc0d35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T03:53:21.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.145+0000 7ff9d0b1a640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 0x7ff9cc0d35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.326+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185707409 0 0) 0x7ff9cc0d3c60 con 0x7ff9cc15f250 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.326+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b8003520 con 0x7ff9cc15f250 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1828735559 0 0) 0x7ff9b8003520 con 0x7ff9cc15f250 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 msgr2=0x7ff9cc0d35f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.64:3300/0 conn(0x7ff9cc0b7480 0x7ff9cc0d35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 msgr2=0x7ff9cc0d4d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:53:21.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 --2- 172.21.15.55:0/900458309 >> v2:172.21.15.55:3300/0 conn(0x7ff9cc15f630 0x7ff9cc0d4d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc0d4500 con 0x7ff9cc15f250 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7ff9c80016f0 con 0x7ff9cc15f250 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 >> v1:172.21.15.55:6789/0 conn(0x7ff9cc15f250 legacy=0x7ff9cc0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8003aa0 0x7ff9b8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9b8004800 0x7ff9b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8005210 0x7ff9b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d3f40 con 0x7ff9b8003aa0 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d4220 con 0x7ff9b8005210 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b800c1a0 con 0x7ff9b8004800 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d131b640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8003aa0 0x7ff9b8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8005210 0x7ff9b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d0b1a640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9b8004800 0x7ff9b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d131b640 1 -- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9b8004800 msgr2=0x7ff9b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d131b640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9b8004800 0x7ff9b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d131b640 1 -- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8005210 msgr2=0x7ff9b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d131b640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8005210 0x7ff9b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/900458309 reap_dead start 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.327+0000 7ff9d131b640 1 -- 172.21.15.55:0/900458309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b8003520 con 0x7ff9b8003aa0 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.328+0000 7ff9d131b640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8003aa0 0x7ff9b8003ec0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8007fa0 tx=0x7ff9b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f3a75449121536 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.328+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8036070 con 0x7ff9b8003aa0 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.328+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c8031620 con 0x7ff9b8003aa0 2024-05-10T03:53:21.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.328+0000 7ff9c3fff640 1 -- 172.21.15.55:0/900458309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8007bc0 con 0x7ff9b8003aa0 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 -- 172.21.15.55:0/900458309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8003aa0 msgr2=0x7ff9b8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8003aa0 0x7ff9b8003ec0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8007fa0 tx=0x7ff9b8005830 comp rx=0 tx=0).stop 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 -- 172.21.15.55:0/900458309 shutdown_connections 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 --2- 172.21.15.55:0/900458309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b8003aa0 0x7ff9b8003ec0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 -- 172.21.15.55:0/900458309 >> 172.21.15.55:0/900458309 conn(0x7ff9cc0740f0 msgr2=0x7ff9cc0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 -- 172.21.15.55:0/900458309 shutdown_connections 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.329+0000 7ff9d357f640 1 -- 172.21.15.55:0/900458309 wait complete. 2024-05-10T03:53:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.331+0000 7ff9d357f640 1 Processor -- start 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.331+0000 7ff9d357f640 1 -- start start 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.331+0000 7ff9d357f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 0x7ff9cc0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.331+0000 7ff9d357f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 0x7ff9cc0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d357f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9cc14c240 0x7ff9cc14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d357f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d3770 con 0x7ff9cc14c240 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d357f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d35f0 con 0x7ff9b8003aa0 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d357f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc0d38f0 con 0x7ff9cc0ca450 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d131b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 0x7ff9cc0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d0b1a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 0x7ff9cc0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d0b1a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 0x7ff9cc0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:59876/0 (socket says 172.21.15.55:59876) 2024-05-10T03:53:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d131b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 0x7ff9cc0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:57314/0 (socket says 172.21.15.55:57314) 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d0b1a640 1 -- 172.21.15.55:0/3208684189 learned_addr learned my addr 172.21.15.55:0/3208684189 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9cc14c240 0x7ff9cc14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 msgr2=0x7ff9cc0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 0x7ff9cc0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 msgr2=0x7ff9cc0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 0x7ff9cc0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 -- 172.21.15.55:0/3208684189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc14cc00 con 0x7ff9cc14c240 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d0b1a640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 0x7ff9cc0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d131b640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 0x7ff9cc0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d1b1c640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9cc14c240 0x7ff9cc14c6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0d3050 tx=0x7ff9c400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c401b070 con 0x7ff9cc14c240 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c4003990 con 0x7ff9cc14c240 2024-05-10T03:53:21.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4003d80 con 0x7ff9cc14c240 2024-05-10T03:53:21.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.332+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc0cd900 con 0x7ff9cc14c240 2024-05-10T03:53:21.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.333+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9c401e070 con 0x7ff9cc14c240 2024-05-10T03:53:21.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.333+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc0c9c50 con 0x7ff9cc14c240 2024-05-10T03:53:21.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.333+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff9c4009de0 con 0x7ff9cc14c240 2024-05-10T03:53:21.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.334+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc06a7e0 con 0x7ff9cc14c240 2024-05-10T03:53:21.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.336+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff9c4025070 con 0x7ff9cc14c240 2024-05-10T03:53:21.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.403+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff9cc0c8a00 con 0x7ff9cc14c240 2024-05-10T03:53:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.405+0000 7ff9c1ffb640 1 -- 172.21.15.55:0/3208684189 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff9c400a070 con 0x7ff9cc14c240 2024-05-10T03:53:21.408 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9cc14c240 msgr2=0x7ff9cc14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9cc14c240 0x7ff9cc14c6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0d3050 tx=0x7ff9c400f520 comp rx=0 tx=0).stop 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 shutdown_connections 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9cc14c240 0x7ff9cc14c6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9cc0ca450 0x7ff9cc0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 --2- 172.21.15.55:0/3208684189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9b8003aa0 0x7ff9cc0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 >> 172.21.15.55:0/3208684189 conn(0x7ff9cc0740f0 msgr2=0x7ff9cc0cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 shutdown_connections 2024-05-10T03:53:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:21.406+0000 7ff9d357f640 1 -- 172.21.15.55:0/3208684189 wait complete. 2024-05-10T03:53:21.419 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T03:53:21.419 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T03:53:21.420 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:21.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T03:53:21.443 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:21.441+0000 7f7b7660d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:53:21.446 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:21.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T03:53:21.513 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:21.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T03:53:21.579 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:21.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T03:53:21.617 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:21.614+0000 7f7b7660d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:53:21.643 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:21.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T03:53:21.671 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:21.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T03:53:21.675 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:21.673+0000 7f7b7660d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:53:21.738 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:21.739 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T03:53:21.805 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:53:21.806 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T03:53:21.836 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:21.833+0000 7f3be860e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T03:53:21.861 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 9629c521-758a-4133-a133-430db518f8c6 0 2024-05-10T03:53:21.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:21.925+0000 7f7b7660d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:53:21.976 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:21.973+0000 7f7b7660d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:53:22.001 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:21.998+0000 7f3be860e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:53:22.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.001+0000 7f0d2f358640 1 Processor -- start 2024-05-10T03:53:22.004 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.002+0000 7f0d2f358640 1 -- start start 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2f358640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0d2815c060 0x7f0d280b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2f358640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d28071060 0x7f0d280b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2f358640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d280cf7f0 con 0x7f0d280b68d0 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2f358640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f0d280b6d40 con 0x7f0d28071060 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2f358640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f0d280cfb00 con 0x7f0d2815c060 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0d2815c060 0x7f0d280b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0d2815c060 0x7f0d280b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46508/0 (socket says 172.21.15.64:46508) 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 -- 172.21.15.64:0/68367258 learned_addr learned my addr 172.21.15.64:0/68367258 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.007 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2c8f3640 1 --2- 172.21.15.64:0/68367258 >> v2:172.21.15.55:3300/0 conn(0x7f0d28071060 0x7f0d280b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 -- 172.21.15.64:0/68367258 >> v2:172.21.15.55:3300/0 conn(0x7f0d28071060 msgr2=0x7f0d280b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 --2- 172.21.15.64:0/68367258 >> v2:172.21.15.55:3300/0 conn(0x7f0d28071060 0x7f0d280b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 -- 172.21.15.64:0/68367258 >> v1:172.21.15.64:6789/0 conn(0x7f0d280b68d0 legacy=0x7f0d280733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.003+0000 7f0d2d0f4640 1 -- 172.21.15.64:0/68367258 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2815c440 con 0x7f0d2815c060 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.004+0000 7f0d2d0f4640 1 --2- 172.21.15.64:0/68367258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d2815c060 0x7f0d280b5040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d280cfc80 tx=0x7f0d2402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcef790328655b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.004+0000 7f0d1ffff640 1 -- 172.21.15.64:0/68367258 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24037070 con 0x7f0d2815c060 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.004+0000 7f0d1ffff640 1 -- 172.21.15.64:0/68367258 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d24032440 con 0x7f0d2815c060 2024-05-10T03:53:22.008 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.004+0000 7f0d1ffff640 1 -- 172.21.15.64:0/68367258 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24032810 con 0x7f0d2815c060 2024-05-10T03:53:22.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.004+0000 7f0d2f358640 1 -- 172.21.15.64:0/68367258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d2815c060 msgr2=0x7f0d280b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.004+0000 7f0d2f358640 1 --2- 172.21.15.64:0/68367258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d2815c060 0x7f0d280b5040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d280cfc80 tx=0x7f0d2402a270 comp rx=0 tx=0).stop 2024-05-10T03:53:22.011 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.005+0000 7f0d2f358640 1 -- 172.21.15.64:0/68367258 shutdown_connections 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.005+0000 7f0d2f358640 1 --2- 172.21.15.64:0/68367258 >> v2:172.21.15.55:3300/0 conn(0x7f0d28071060 0x7f0d280b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.005+0000 7f0d2f358640 1 --2- 172.21.15.64:0/68367258 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d2815c060 0x7f0d280b5040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.005+0000 7f0d2f358640 1 -- 172.21.15.64:0/68367258 >> 172.21.15.64:0/68367258 conn(0x7f0d2806f510 msgr2=0x7f0d2806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.005+0000 7f0d2f358640 1 -- 172.21.15.64:0/68367258 shutdown_connections 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.005+0000 7f0d2f358640 1 -- 172.21.15.64:0/68367258 wait complete. 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.006+0000 7f0d2f358640 1 Processor -- start 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.006+0000 7f0d2f358640 1 -- start start 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0d28071060 0x7f0d28144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 0x7f0d2814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d2815c060 0x7f0d2814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280b5f50 con 0x7f0d2815c060 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280b5c70 con 0x7f0d280b68d0 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0d280b5580 con 0x7f0d28071060 2024-05-10T03:53:22.012 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 0x7f0d2814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2d0f4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0d28071060 0x7f0d28144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 0x7f0d2814f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46518/0 (socket says 172.21.15.64:46518) 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 -- 172.21.15.64:0/3119494330 learned_addr learned my addr 172.21.15.64:0/3119494330 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2d8f5640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d2815c060 0x7f0d2814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 -- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0d28071060 msgr2=0x7f0d28144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0d28071060 0x7f0d28144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 -- 172.21.15.64:0/3119494330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d2815c060 msgr2=0x7f0d2814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d2815c060 0x7f0d2814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 -- 172.21.15.64:0/3119494330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d28143e40 con 0x7f0d280b68d0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2c8f3640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 0x7f0d2814f1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800e980 tx=0x7f0d1800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18017070 con 0x7f0d280b68d0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1800ca00 con 0x7f0d280b68d0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d28144120 con 0x7f0d280b68d0 2024-05-10T03:53:22.013 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.007+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800cdd0 con 0x7f0d280b68d0 2024-05-10T03:53:22.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.008+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d281446e0 con 0x7f0d280b68d0 2024-05-10T03:53:22.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.008+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d1801a070 con 0x7f0d280b68d0 2024-05-10T03:53:22.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.008+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0d1801c900 con 0x7f0d280b68d0 2024-05-10T03:53:22.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.009+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2806a7e0 con 0x7f0d280b68d0 2024-05-10T03:53:22.014 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.011+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0d18013470 con 0x7f0d280b68d0 2024-05-10T03:53:22.059 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:22.056+0000 7f3be860e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T03:53:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.085+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9629c521-758a-4133-a133-430db518f8c6", "id": 0} v 0) -- 0x7f0d28140070 con 0x7f0d280b68d0 2024-05-10T03:53:22.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.092+0000 7f0d1dffb640 1 -- 172.21.15.64:0/3119494330 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9629c521-758a-4133-a133-430db518f8c6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0d1801cc80 con 0x7f0d280b68d0 2024-05-10T03:53:22.095 INFO:teuthology.orchestra.run.smithi064.stdout:0 2024-05-10T03:53:22.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 msgr2=0x7f0d2814f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 0x7f0d2814f1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800e980 tx=0x7f0d1800ee40 comp rx=0 tx=0).stop 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 shutdown_connections 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d2815c060 0x7f0d2814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0d280b68d0 0x7f0d2814f1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 --2- 172.21.15.64:0/3119494330 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0d28071060 0x7f0d28144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 >> 172.21.15.64:0/3119494330 conn(0x7f0d2806f510 msgr2=0x7f0d2806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 shutdown_connections 2024-05-10T03:53:22.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.093+0000 7f0d2f358640 1 -- 172.21.15.64:0/3119494330 wait complete. 2024-05-10T03:53:22.107 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 860c3a27-ab92-46c3-a14f-0cf3be4bf236 1 2024-05-10T03:53:22.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.206+0000 7f3a62293640 1 Processor -- start 2024-05-10T03:53:22.209 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.206+0000 7f3a62293640 1 -- start start 2024-05-10T03:53:22.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a62293640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a62293640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3a5c0b81a0 0x7f3a5c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.210 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a62293640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c072ce0 con 0x7f3a5c0cfc60 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a62293640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c0d0c40 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a62293640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c0b8710 con 0x7f3a5c146dd0 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5b7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3a5c0b81a0 0x7f3a5c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37382/0 (socket says 172.21.15.64:37382) 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5bfff640 1 -- 172.21.15.64:0/2816243037 learned_addr learned my addr 172.21.15.64:0/2816243037 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5b7fe640 1 -- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 msgr2=0x7f3a5c0727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5b7fe640 1 --2- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5b7fe640 1 -- 172.21.15.64:0/2816243037 >> v1:172.21.15.64:6789/0 conn(0x7f3a5c0cfc60 legacy=0x7f3a5c0d2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5b7fe640 1 -- 172.21.15.64:0/2816243037 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c0b89f0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.211 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.207+0000 7f3a5bfff640 1 --2- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.208+0000 7f3a5b7fe640 1 --2- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c0cf720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a500097d0 tx=0x7f3a5002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe3b33fd48bb96b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.208+0000 7f3a5affd640 1 -- 172.21.15.64:0/2816243037 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50037070 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.208+0000 7f3a5affd640 1 -- 172.21.15.64:0/2816243037 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a50032440 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.208+0000 7f3a5affd640 1 -- 172.21.15.64:0/2816243037 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50032810 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 -- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 msgr2=0x7f3a5c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 --2- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c0cf720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a500097d0 tx=0x7f3a5002a1c0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 -- 172.21.15.64:0/2816243037 shutdown_connections 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 --2- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c0cf720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 --2- 172.21.15.64:0/2816243037 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.213 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 -- 172.21.15.64:0/2816243037 >> 172.21.15.64:0/2816243037 conn(0x7f3a5c06c9c0 msgr2=0x7f3a5c0706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 -- 172.21.15.64:0/2816243037 shutdown_connections 2024-05-10T03:53:22.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.209+0000 7f3a62293640 1 -- 172.21.15.64:0/2816243037 wait complete. 2024-05-10T03:53:22.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.210+0000 7f3a62293640 1 Processor -- start 2024-05-10T03:53:22.214 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.210+0000 7f3a62293640 1 -- start start 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a62293640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c1eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a62293640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a5c0cfc60 0x7f3a5c0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a62293640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a62293640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0d2870 con 0x7f3a5c0cfc60 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a62293640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0d26f0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a62293640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c0d29f0 con 0x7f3a5c146dd0 2024-05-10T03:53:22.217 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c1eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c1eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46550/0 (socket says 172.21.15.64:46550) 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a60830640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 -- 172.21.15.64:0/611259786 learned_addr learned my addr 172.21.15.64:0/611259786 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5b7fe640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a5c0cfc60 0x7f3a5c0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 -- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 msgr2=0x7f3a5c0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 -- 172.21.15.64:0/611259786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a5c0cfc60 msgr2=0x7f3a5c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a5c0cfc60 0x7f3a5c0ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.211+0000 7f3a5bfff640 1 -- 172.21.15.64:0/611259786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c1f4d20 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a5bfff640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c1eebd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00e9b0 tx=0x7f3a4c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c017070 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00c9a0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00cd50 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.218 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c1f5000 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c1f5ae0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a4c01a070 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.212+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f3a4c01c800 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.213+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c06a7e0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.215+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3a4c01ca00 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.292 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.289+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd new", "uuid": "860c3a27-ab92-46c3-a14f-0cf3be4bf236", "id": 1} v 0) -- 0x7f3a5c06f6b0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.299 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.296+0000 7f3a58ff9640 1 -- 172.21.15.64:0/611259786 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "860c3a27-ab92-46c3-a14f-0cf3be4bf236", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3a4c01ccb0 con 0x7f3a5c0b81a0 2024-05-10T03:53:22.299 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 msgr2=0x7f3a5c1eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c1eebd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00e9b0 tx=0x7f3a4c00ee70 comp rx=0 tx=0).stop 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 shutdown_connections 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a5c146dd0 0x7f3a5c0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a5c0cfc60 0x7f3a5c0ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 --2- 172.21.15.64:0/611259786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a5c0b81a0 0x7f3a5c1eebd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.301 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 >> 172.21.15.64:0/611259786 conn(0x7f3a5c06c9c0 msgr2=0x7f3a5c141da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 shutdown_connections 2024-05-10T03:53:22.302 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.297+0000 7f3a62293640 1 -- 172.21.15.64:0/611259786 wait complete. 2024-05-10T03:53:22.311 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 30621317-d378-4372-93d6-04a972bf4652 2 2024-05-10T03:53:22.327 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:22.324+0000 7f3be860e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T03:53:22.377 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:22.374+0000 7f3be860e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T03:53:22.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.411+0000 7fbfaabf0640 1 Processor -- start 2024-05-10T03:53:22.415 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.411+0000 7fbfaabf0640 1 -- start start 2024-05-10T03:53:22.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfaabf0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa415d3c0 0x7fbfa40b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfaabf0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbfa40d26f0 0x7fbfa4072480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfaabf0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40b6f20 con 0x7fbfa40b4c70 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfaabf0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa4072d80 con 0x7fbfa40d26f0 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfaabf0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa40b71c0 con 0x7fbfa415d3c0 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbfa40d26f0 0x7fbfa4072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa898c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa415d3c0 0x7fbfa40b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa898c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa415d3c0 0x7fbfa40b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37394/0 (socket says 172.21.15.64:37394) 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa898c640 1 -- 172.21.15.64:0/599501916 learned_addr learned my addr 172.21.15.64:0/599501916 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbfa40d26f0 0x7fbfa4072480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46556/0 (socket says 172.21.15.64:46556) 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa3fff640 1 -- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa415d3c0 msgr2=0x7fbfa40b7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa3fff640 1 --2- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa415d3c0 0x7fbfa40b7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa3fff640 1 -- 172.21.15.64:0/599501916 >> v1:172.21.15.55:6789/0 conn(0x7fbfa40b4c70 legacy=0x7fbfa40d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:22.420 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.413+0000 7fbfa3fff640 1 -- 172.21.15.64:0/599501916 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40b7460 con 0x7fbfa40d26f0 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.414+0000 7fbfa3fff640 1 --2- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa40d26f0 0x7fbfa4072480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf900097a0 tx=0x7fbf9002a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932a0bc50e2f9871 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.414+0000 7fbfa37fe640 1 -- 172.21.15.64:0/599501916 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90037070 con 0x7fbfa40d26f0 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.414+0000 7fbfa37fe640 1 -- 172.21.15.64:0/599501916 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9002ae30 con 0x7fbfa40d26f0 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.414+0000 7fbfa37fe640 1 -- 172.21.15.64:0/599501916 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90032640 con 0x7fbfa40d26f0 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 -- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa40d26f0 msgr2=0x7fbfa4072480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa40d26f0 0x7fbfa4072480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf900097a0 tx=0x7fbf9002a0e0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 -- 172.21.15.64:0/599501916 shutdown_connections 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa40d26f0 0x7fbfa4072480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.421 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/599501916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa415d3c0 0x7fbfa40b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 -- 172.21.15.64:0/599501916 >> 172.21.15.64:0/599501916 conn(0x7fbfa406c390 msgr2=0x7fbfa406c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 -- 172.21.15.64:0/599501916 shutdown_connections 2024-05-10T03:53:22.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.415+0000 7fbfaabf0640 1 -- 172.21.15.64:0/599501916 wait complete. 2024-05-10T03:53:22.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.416+0000 7fbfaabf0640 1 Processor -- start 2024-05-10T03:53:22.422 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.417+0000 7fbfaabf0640 1 -- start start 2024-05-10T03:53:22.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfaabf0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfa40b4c70 0x7fbfa41527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfaabf0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 0x7fbfa4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfaabf0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa415d3c0 0x7fbfa40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfaabf0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40729c0 con 0x7fbfa40b4c70 2024-05-10T03:53:22.425 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfaabf0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40b7a20 con 0x7fbfa415d3c0 2024-05-10T03:53:22.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfaabf0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa4072b40 con 0x7fbfa40d26f0 2024-05-10T03:53:22.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfa3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 0x7fbfa4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfa918d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa415d3c0 0x7fbfa40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfa3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 0x7fbfa4153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37406/0 (socket says 172.21.15.64:37406) 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfa3fff640 1 -- 172.21.15.64:0/3950653786 learned_addr learned my addr 172.21.15.64:0/3950653786 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.418+0000 7fbfa898c640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfa40b4c70 0x7fbfa41527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa918d640 1 -- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 msgr2=0x7fbfa4153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa918d640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 0x7fbfa4153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa918d640 1 -- 172.21.15.64:0/3950653786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfa40b4c70 msgr2=0x7fbfa41527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa918d640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfa40b4c70 0x7fbfa41527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa918d640 1 -- 172.21.15.64:0/3950653786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa4154460 con 0x7fbfa415d3c0 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa3fff640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 0x7fbfa4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa918d640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa415d3c0 0x7fbfa40b3ca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c780 tx=0x7fbf9c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c016020 con 0x7fbfa415d3c0 2024-05-10T03:53:22.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00aa50 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00ce30 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa4152e80 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa4153440 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbf9c019020 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.419+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbf9c012840 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.420+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa406a7e0 con 0x7fbfa415d3c0 2024-05-10T03:53:22.428 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.422+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbf9c020030 con 0x7fbfa415d3c0 2024-05-10T03:53:22.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.496+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30621317-d378-4372-93d6-04a972bf4652", "id": 2} v 0) -- 0x7fbfa40b7ee0 con 0x7fbfa415d3c0 2024-05-10T03:53:22.502 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.499+0000 7fbfa17fa640 1 -- 172.21.15.64:0/3950653786 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30621317-d378-4372-93d6-04a972bf4652", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbf9c012420 con 0x7fbfa415d3c0 2024-05-10T03:53:22.502 INFO:teuthology.orchestra.run.smithi064.stdout:2 2024-05-10T03:53:22.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa415d3c0 msgr2=0x7fbfa40b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.503 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa415d3c0 0x7fbfa40b3ca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c780 tx=0x7fbf9c00cc40 comp rx=0 tx=0).stop 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 shutdown_connections 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbfa415d3c0 0x7fbfa40b3ca0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbfa40d26f0 0x7fbfa4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 --2- 172.21.15.64:0/3950653786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfa40b4c70 0x7fbfa41527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 >> 172.21.15.64:0/3950653786 conn(0x7fbfa406c390 msgr2=0x7fbfa415c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 shutdown_connections 2024-05-10T03:53:22.504 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.500+0000 7fbfaabf0640 1 -- 172.21.15.64:0/3950653786 wait complete. 2024-05-10T03:53:22.514 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new af0dd4b2-b7a1-4d5d-b201-df349eae9b73 3 2024-05-10T03:53:22.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.653+0000 7f4c64259640 1 Processor -- start 2024-05-10T03:53:22.656 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.653+0000 7f4c64259640 1 -- start start 2024-05-10T03:53:22.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c64259640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b7480 0x7f4c5c0d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c64259640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c0d3c60 con 0x7f4c5c15f630 2024-05-10T03:53:22.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c64259640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c5c0d3f40 con 0x7f4c5c15f250 2024-05-10T03:53:22.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c64259640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f4c5c0d4220 con 0x7f4c5c0b7480 2024-05-10T03:53:22.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c61ff5640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f4c5c15f250 0x7f4c5c0b6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:51148/0 (socket says 172.21.15.64:51148) 2024-05-10T03:53:22.657 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c61ff5640 1 -- 172.21.15.64:0/294737898 learned_addr learned my addr 172.21.15.64:0/294737898 (peer_addr_for_me v1:172.21.15.64:0/0) 2024-05-10T03:53:22.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c617f4640 1 --2- 172.21.15.64:0/294737898 >> v2:172.21.15.55:3300/0 conn(0x7f4c5c0b7480 0x7f4c5c0d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c60ff3640 1 -- 172.21.15.64:0/294737898 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125238996 0 0) 0x7f4c5c0d3f40 con 0x7f4c5c15f250 2024-05-10T03:53:22.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c60ff3640 1 -- 172.21.15.64:0/294737898 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c48003520 con 0x7f4c5c15f250 2024-05-10T03:53:22.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c617f4640 1 -- 172.21.15.64:0/294737898 >> v1:172.21.15.64:6789/0 conn(0x7f4c5c15f250 legacy=0x7f4c5c0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c617f4640 1 -- 172.21.15.64:0/294737898 >> v1:172.21.15.55:6789/0 conn(0x7f4c5c15f630 legacy=0x7f4c5c0b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.658 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.654+0000 7f4c617f4640 1 -- 172.21.15.64:0/294737898 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c0d4500 con 0x7f4c5c0b7480 2024-05-10T03:53:22.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.655+0000 7f4c617f4640 1 --2- 172.21.15.64:0/294737898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c0b7480 0x7f4c5c0d35f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0097a0 tx=0x7f4c4c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff768ba381ccc63 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.655+0000 7f4c60ff3640 1 -- 172.21.15.64:0/294737898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c037070 con 0x7f4c5c0b7480 2024-05-10T03:53:22.659 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.655+0000 7f4c60ff3640 1 -- 172.21.15.64:0/294737898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c032640 con 0x7f4c5c0b7480 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.655+0000 7f4c60ff3640 1 -- 172.21.15.64:0/294737898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0329f0 con 0x7f4c5c0b7480 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 -- 172.21.15.64:0/294737898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c0b7480 msgr2=0x7f4c5c0d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 --2- 172.21.15.64:0/294737898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c0b7480 0x7f4c5c0d35f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0097a0 tx=0x7f4c4c02a2c0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 -- 172.21.15.64:0/294737898 shutdown_connections 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 --2- 172.21.15.64:0/294737898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c0b7480 0x7f4c5c0d35f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 -- 172.21.15.64:0/294737898 >> 172.21.15.64:0/294737898 conn(0x7f4c5c0740f0 msgr2=0x7f4c5c0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 -- 172.21.15.64:0/294737898 shutdown_connections 2024-05-10T03:53:22.660 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.656+0000 7f4c64259640 1 -- 172.21.15.64:0/294737898 wait complete. 2024-05-10T03:53:22.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.657+0000 7f4c64259640 1 Processor -- start 2024-05-10T03:53:22.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.657+0000 7f4c64259640 1 -- start start 2024-05-10T03:53:22.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c64259640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 0x7f4c5c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c64259640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c15f250 0x7f4c5c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.663 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c64259640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c5c15f630 0x7f4c5c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c64259640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0d4ec0 con 0x7f4c5c15f250 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c64259640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c0d4d40 con 0x7f4c5c15f630 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c64259640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5c0d5040 con 0x7f4c5c0b7480 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c61ff5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 0x7f4c5c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c627f6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c5c15f630 0x7f4c5c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c61ff5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 0x7f4c5c159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37420/0 (socket says 172.21.15.64:37420) 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c61ff5640 1 -- 172.21.15.64:0/197868264 learned_addr learned my addr 172.21.15.64:0/197868264 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.658+0000 7f4c617f4640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c15f250 0x7f4c5c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c61ff5640 1 -- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c5c15f630 msgr2=0x7f4c5c0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c61ff5640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c5c15f630 0x7f4c5c0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c61ff5640 1 -- 172.21.15.64:0/197868264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c15f250 msgr2=0x7f4c5c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.664 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c61ff5640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c15f250 0x7f4c5c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c61ff5640 1 -- 172.21.15.64:0/197868264 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c0cd180 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c617f4640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c15f250 0x7f4c5c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c61ff5640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 0x7f4c5c159860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c460 tx=0x7f4c5800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58017070 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c58005d00 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c0cd460 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c580072b0 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c0cda20 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c5801a070 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.659+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4c58012890 con 0x7f4c5c0b7480 2024-05-10T03:53:22.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.660+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5c0d0410 con 0x7f4c5c0b7480 2024-05-10T03:53:22.666 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.664+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4c5c0d0410 con 0x7f4c5c0b7480 2024-05-10T03:53:22.732 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:22.729+0000 7f7b7660d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:53:22.741 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.738+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af0dd4b2-b7a1-4d5d-b201-df349eae9b73", "id": 3} v 0) -- 0x7f4c5c06a7e0 con 0x7f4c5c0b7480 2024-05-10T03:53:22.745 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.741+0000 7f4c527fc640 1 -- 172.21.15.64:0/197868264 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af0dd4b2-b7a1-4d5d-b201-df349eae9b73", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4c58021020 con 0x7f4c5c0b7480 2024-05-10T03:53:22.745 INFO:teuthology.orchestra.run.smithi064.stdout:3 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 msgr2=0x7f4c5c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 0x7f4c5c159860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c460 tx=0x7f4c5800c920 comp rx=0 tx=0).stop 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 shutdown_connections 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c5c15f630 0x7f4c5c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c5c15f250 0x7f4c5c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 --2- 172.21.15.64:0/197868264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c5c0b7480 0x7f4c5c159860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 >> 172.21.15.64:0/197868264 conn(0x7f4c5c0740f0 msgr2=0x7f4c5c15b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.742+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 shutdown_connections 2024-05-10T03:53:22.746 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.743+0000 7f4c64259640 1 -- 172.21.15.64:0/197868264 wait complete. 2024-05-10T03:53:22.756 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 2d657b0f-cf76-48fa-8aa1-430fe9f8bee6 4 2024-05-10T03:53:22.824 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:22.821+0000 7f7b7660d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:53:22.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.855+0000 7f6bb4a83640 1 Processor -- start 2024-05-10T03:53:22.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.855+0000 7f6bb4a83640 1 -- start start 2024-05-10T03:53:22.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6bb4a83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6bb015ccc0 0x7f6bb00b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6bb4a83640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6bb00b5300 0x7f6bb00b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.860 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6bb4a83640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb00b5c40 con 0x7f6bb015d0a0 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6bb4a83640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb00b3830 con 0x7f6bb015ccc0 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6bb4a83640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb00b32f0 con 0x7f6bb00b5300 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6baed9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6bb00b5300 0x7f6bb00b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6baed9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6bb00b5300 0x7f6bb00b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46572/0 (socket says 172.21.15.64:46572) 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6baed9d640 1 -- 172.21.15.64:0/3549377011 learned_addr learned my addr 172.21.15.64:0/3549377011 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.856+0000 7f6bae59c640 1 --2- 172.21.15.64:0/3549377011 >> v2:172.21.15.55:3300/0 conn(0x7f6bb015ccc0 0x7f6bb00b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.857+0000 7f6baed9d640 1 -- 172.21.15.64:0/3549377011 >> v2:172.21.15.55:3300/0 conn(0x7f6bb015ccc0 msgr2=0x7f6bb00b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.857+0000 7f6baed9d640 1 --2- 172.21.15.64:0/3549377011 >> v2:172.21.15.55:3300/0 conn(0x7f6bb015ccc0 0x7f6bb00b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.857+0000 7f6baed9d640 1 -- 172.21.15.64:0/3549377011 >> v1:172.21.15.64:6789/0 conn(0x7f6bb015d0a0 legacy=0x7f6bb00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.857+0000 7f6baed9d640 1 -- 172.21.15.64:0/3549377011 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb00b3550 con 0x7f6bb00b5300 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.857+0000 7f6baed9d640 1 --2- 172.21.15.64:0/3549377011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb00b5300 0x7f6bb00b5700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0073950 tx=0x7f6ba802c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c62f74df92a1df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bad59a640 1 -- 172.21.15.64:0/3549377011 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800b2e0 con 0x7f6bb00b5300 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bad59a640 1 -- 172.21.15.64:0/3549377011 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba8037070 con 0x7f6bb00b5300 2024-05-10T03:53:22.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bad59a640 1 -- 172.21.15.64:0/3549377011 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800b480 con 0x7f6bb00b5300 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 -- 172.21.15.64:0/3549377011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb00b5300 msgr2=0x7f6bb00b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/3549377011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb00b5300 0x7f6bb00b5700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0073950 tx=0x7f6ba802c940 comp rx=0 tx=0).stop 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 -- 172.21.15.64:0/3549377011 shutdown_connections 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/3549377011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb00b5300 0x7f6bb00b5700 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/3549377011 >> v2:172.21.15.55:3300/0 conn(0x7f6bb015ccc0 0x7f6bb00b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 -- 172.21.15.64:0/3549377011 >> 172.21.15.64:0/3549377011 conn(0x7f6bb006c390 msgr2=0x7f6bb006c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 -- 172.21.15.64:0/3549377011 shutdown_connections 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.858+0000 7f6bb4a83640 1 -- 172.21.15.64:0/3549377011 wait complete. 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 Processor -- start 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 -- start start 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb00b5300 0x7f6bb0151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 0x7f6bb01478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 0x7f6bb00afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb00b45b0 con 0x7f6bb00b5300 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb00b42d0 con 0x7f6bb015d0a0 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.860+0000 7f6bb4a83640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb015d550 con 0x7f6bb015ccc0 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6badd9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 0x7f6bb01478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6baed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 0x7f6bb00afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6badd9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 0x7f6bb01478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37432/0 (socket says 172.21.15.64:37432) 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb00b5300 0x7f6bb0151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6badd9b640 1 -- 172.21.15.64:0/2026057238 learned_addr learned my addr 172.21.15.64:0/2026057238 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6baed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 0x7f6bb00afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46580/0 (socket says 172.21.15.64:46580) 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 -- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 msgr2=0x7f6bb01478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 0x7f6bb01478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 -- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 msgr2=0x7f6bb00afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 0x7f6bb00afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 -- 172.21.15.64:0/2026057238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb00aedc0 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6baed9d640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 0x7f6bb00afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6badd9b640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 0x7f6bb01478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bae59c640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb00b5300 0x7f6bb0151650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000e850 tx=0x7f6ba000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0017070 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba000c940 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb00af0a0 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000cd10 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.861+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb00af660 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.862+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ba001a070 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.862+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6ba001c9e0 con 0x7f6bb00b5300 2024-05-10T03:53:22.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.862+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb006a7e0 con 0x7f6bb00b5300 2024-05-10T03:53:22.871 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:22.868+0000 7f7b7660d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:53:22.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.867+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6ba001cce0 con 0x7f6bb00b5300 2024-05-10T03:53:22.946 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.943+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d657b0f-cf76-48fa-8aa1-430fe9f8bee6", "id": 4} v 0) -- 0x7f6bb0151b90 con 0x7f6bb00b5300 2024-05-10T03:53:22.951 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.949+0000 7f6b9effd640 1 -- 172.21.15.64:0/2026057238 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d657b0f-cf76-48fa-8aa1-430fe9f8bee6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6ba001c450 con 0x7f6bb00b5300 2024-05-10T03:53:22.952 INFO:teuthology.orchestra.run.smithi064.stdout:4 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb00b5300 msgr2=0x7f6bb0151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb00b5300 0x7f6bb0151650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000e850 tx=0x7f6ba000ed10 comp rx=0 tx=0).stop 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 shutdown_connections 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6bb015d0a0 0x7f6bb00afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6bb015ccc0 0x7f6bb01478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 --2- 172.21.15.64:0/2026057238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bb00b5300 0x7f6bb0151650 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 >> 172.21.15.64:0/2026057238 conn(0x7f6bb006c390 msgr2=0x7f6bb00d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 shutdown_connections 2024-05-10T03:53:22.953 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:22.950+0000 7f6bb4a83640 1 -- 172.21.15.64:0/2026057238 wait complete. 2024-05-10T03:53:22.963 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374 5 2024-05-10T03:53:23.045 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:23.042+0000 7f7b7660d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:53:23.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.063+0000 7f7659d6a640 1 Processor -- start 2024-05-10T03:53:23.066 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.063+0000 7f7659d6a640 1 -- start start 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7659d6a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f76540b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7659d6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7654070420 0x7f76540af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7659d6a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 0x7f76540736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7659d6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f76540b59e0 con 0x7f7654070420 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7659d6a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f76540709e0 con 0x7f76540afb70 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7659d6a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7654070cc0 con 0x7f765415f430 2024-05-10T03:53:23.068 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7653fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 0x7f76540736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f76540b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7653fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 0x7f76540736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46584/0 (socket says 172.21.15.64:46584) 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f76540b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37436/0 (socket says 172.21.15.64:37436) 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7653fff640 1 -- 172.21.15.64:0/2661891253 learned_addr learned my addr 172.21.15.64:0/2661891253 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7652ffd640 1 --2- 172.21.15.64:0/2661891253 >> v2:172.21.15.55:3300/0 conn(0x7f7654070420 0x7f76540af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 -- 172.21.15.64:0/2661891253 >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 msgr2=0x7f76540736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 --2- 172.21.15.64:0/2661891253 >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 0x7f76540736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 -- 172.21.15.64:0/2661891253 >> v2:172.21.15.55:3300/0 conn(0x7f7654070420 msgr2=0x7f76540af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 --2- 172.21.15.64:0/2661891253 >> v2:172.21.15.55:3300/0 conn(0x7f7654070420 0x7f76540af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f76537fe640 1 -- 172.21.15.64:0/2661891253 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765406ef70 con 0x7f765415f430 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.064+0000 7f7653fff640 1 --2- 172.21.15.64:0/2661891253 >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 0x7f76540736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.065+0000 7f76537fe640 1 --2- 172.21.15.64:0/2661891253 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f76540b54a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7654068180 tx=0x7f764402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2abef1e090f87b8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.065+0000 7f76527fc640 1 -- 172.21.15.64:0/2661891253 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644037070 con 0x7f765415f430 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.065+0000 7f76527fc640 1 -- 172.21.15.64:0/2661891253 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7644032440 con 0x7f765415f430 2024-05-10T03:53:23.069 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.065+0000 7f76527fc640 1 -- 172.21.15.64:0/2661891253 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764402ae60 con 0x7f765415f430 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 -- 172.21.15.64:0/2661891253 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 msgr2=0x7f76540b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 --2- 172.21.15.64:0/2661891253 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f76540b54a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7654068180 tx=0x7f764402a110 comp rx=0 tx=0).stop 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 -- 172.21.15.64:0/2661891253 shutdown_connections 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 --2- 172.21.15.64:0/2661891253 >> v2:172.21.15.64:3300/0 conn(0x7f76540afb70 0x7f76540736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 --2- 172.21.15.64:0/2661891253 >> v2:172.21.15.55:3300/0 conn(0x7f7654070420 0x7f76540af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 --2- 172.21.15.64:0/2661891253 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f76540b54a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 -- 172.21.15.64:0/2661891253 >> 172.21.15.64:0/2661891253 conn(0x7f7654072bf0 msgr2=0x7f7654072fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 -- 172.21.15.64:0/2661891253 shutdown_connections 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.066+0000 7f7659d6a640 1 -- 172.21.15.64:0/2661891253 wait complete. 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.067+0000 7f7659d6a640 1 Processor -- start 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.067+0000 7f7659d6a640 1 -- start start 2024-05-10T03:53:23.073 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7659d6a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 0x7f7654160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7659d6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76540afb70 0x7f7654156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7659d6a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f7654153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7659d6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7654071120 con 0x7f76540afb70 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7659d6a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7654070fa0 con 0x7f7654070420 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7659d6a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7654073c20 con 0x7f765415f430 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f76537fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 0x7f7654160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f76537fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 0x7f7654160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46590/0 (socket says 172.21.15.64:46590) 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f76537fe640 1 -- 172.21.15.64:0/724934173 learned_addr learned my addr 172.21.15.64:0/724934173 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7653fff640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f7654153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7652ffd640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76540afb70 0x7f7654156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7653fff640 1 -- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 msgr2=0x7f7654160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7653fff640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 0x7f7654160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7653fff640 1 -- 172.21.15.64:0/724934173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76540afb70 msgr2=0x7f7654156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.074 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.068+0000 7f7653fff640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76540afb70 0x7f7654156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f7653fff640 1 -- 172.21.15.64:0/724934173 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7654156220 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f76537fe640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 0x7f7654160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f7652ffd640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76540afb70 0x7f7654156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f7653fff640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f7654153c50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f764c00efc0 tx=0x7f764c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c00cb20 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c00cce0 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c003bd0 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76541f5f70 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f765415f8b0 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f764c01b030 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.069+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f764c014d90 con 0x7f765415f430 2024-05-10T03:53:23.075 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.070+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765406a7e0 con 0x7f765415f430 2024-05-10T03:53:23.076 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.074+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f764c022020 con 0x7f765415f430 2024-05-10T03:53:23.094 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:23.092+0000 7f7b7660d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:53:23.149 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:23.147+0000 7f7b7660d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:53:23.151 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.148+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374", "id": 5} v 0) -- 0x7f76540aec50 con 0x7f765415f430 2024-05-10T03:53:23.159 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.156+0000 7f763bfff640 1 -- 172.21.15.64:0/724934173 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f764c010040 con 0x7f765415f430 2024-05-10T03:53:23.159 INFO:teuthology.orchestra.run.smithi064.stdout:5 2024-05-10T03:53:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 msgr2=0x7f7654153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.160 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f7654153c50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f764c00efc0 tx=0x7f764c00c490 comp rx=0 tx=0).stop 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 shutdown_connections 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f765415f430 0x7f7654153c50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76540afb70 0x7f7654156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 --2- 172.21.15.64:0/724934173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7654070420 0x7f7654160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 >> 172.21.15.64:0/724934173 conn(0x7f7654072bf0 msgr2=0x7f765415dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 shutdown_connections 2024-05-10T03:53:23.161 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.157+0000 7f7659d6a640 1 -- 172.21.15.64:0/724934173 wait complete. 2024-05-10T03:53:23.171 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 6eec2823-c193-4222-947f-e73ba05c73ab 6 2024-05-10T03:53:23.172 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.169+0000 7f3be860e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T03:53:23.266 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.263+0000 7f3be860e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T03:53:23.267 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:23.265+0000 7f7b7660d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:53:23.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.271+0000 7fa6ae5f7640 1 Processor -- start 2024-05-10T03:53:23.274 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.271+0000 7fa6ae5f7640 1 -- start start 2024-05-10T03:53:23.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6ae5f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6a8148c20 0x7fa6a806c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6ae5f7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a80b5e10 con 0x7fa6a81487a0 2024-05-10T03:53:23.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6ae5f7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a81630f0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6ae5f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a8074720 con 0x7fa6a8148c20 2024-05-10T03:53:23.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6acb94640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fa6a806c8d0 0x7fa6a8070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:51180/0 (socket says 172.21.15.64:51180) 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6acb94640 1 -- 172.21.15.64:0/1033942216 learned_addr learned my addr 172.21.15.64:0/1033942216 (peer_addr_for_me v1:172.21.15.64:0/0) 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6a77fe640 1 --2- 172.21.15.64:0/1033942216 >> v2:172.21.15.55:3300/0 conn(0x7fa6a8148c20 0x7fa6a806c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6a6ffd640 1 -- 172.21.15.64:0/1033942216 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221464104 0 0) 0x7fa6a81630f0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6a6ffd640 1 -- 172.21.15.64:0/1033942216 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa690003520 con 0x7fa6a806c8d0 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6a77fe640 1 -- 172.21.15.64:0/1033942216 >> v1:172.21.15.64:6789/0 conn(0x7fa6a806c8d0 legacy=0x7fa6a8070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6a77fe640 1 -- 172.21.15.64:0/1033942216 >> v1:172.21.15.55:6789/0 conn(0x7fa6a81487a0 legacy=0x7fa6a8073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.272+0000 7fa6a77fe640 1 -- 172.21.15.64:0/1033942216 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a81633d0 con 0x7fa6a8148c20 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.273+0000 7fa6a77fe640 1 --2- 172.21.15.64:0/1033942216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a806c390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0097a0 tx=0x7fa69c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54061a5169713ed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.273+0000 7fa6a6ffd640 1 -- 172.21.15.64:0/1033942216 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c037070 con 0x7fa6a8148c20 2024-05-10T03:53:23.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.273+0000 7fa6a6ffd640 1 -- 172.21.15.64:0/1033942216 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c032440 con 0x7fa6a8148c20 2024-05-10T03:53:23.278 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.273+0000 7fa6a6ffd640 1 -- 172.21.15.64:0/1033942216 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0327f0 con 0x7fa6a8148c20 2024-05-10T03:53:23.281 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/1033942216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 msgr2=0x7fa6a806c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 --2- 172.21.15.64:0/1033942216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a806c390 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0097a0 tx=0x7fa69c02a230 comp rx=0 tx=0).stop 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/1033942216 shutdown_connections 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 --2- 172.21.15.64:0/1033942216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a806c390 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/1033942216 >> 172.21.15.64:0/1033942216 conn(0x7fa6a80b3dd0 msgr2=0x7fa6a80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/1033942216 shutdown_connections 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.274+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/1033942216 wait complete. 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.275+0000 7fa6ae5f7640 1 Processor -- start 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.275+0000 7fa6ae5f7640 1 -- start start 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6ae5f7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6a806c8d0 0x7fa6a8146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6ae5f7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 0x7fa6a815ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6ae5f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6ae5f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8070f30 con 0x7fa6a8148c20 2024-05-10T03:53:23.282 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6ae5f7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8163990 con 0x7fa6a81487a0 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6ae5f7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a80710b0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6a77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 0x7fa6a815ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6a806c8d0 0x7fa6a8146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6a77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 0x7fa6a815ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46592/0 (socket says 172.21.15.64:46592) 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6a77fe640 1 -- 172.21.15.64:0/3230786576 learned_addr learned my addr 172.21.15.64:0/3230786576 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6acb94640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.276+0000 7fa6a7fff640 1 -- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 msgr2=0x7fa6a815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a7fff640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 0x7fa6a815ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a7fff640 1 -- 172.21.15.64:0/3230786576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 msgr2=0x7fa6a80b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a7fff640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a80b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a7fff640 1 -- 172.21.15.64:0/3230786576 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a80b0f50 con 0x7fa6a806c8d0 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a77fe640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 0x7fa6a815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6acb94640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a80b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:23.283 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a7fff640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6a806c8d0 0x7fa6a8146f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c460 tx=0x7fa69800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6980052d0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa698005470 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a815f010 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698012850 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a80b14a0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6980129f0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.277+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa698012ce0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.278+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a806a7e0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.284 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.280+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa6a815f010 con 0x7fa6a806c8d0 2024-05-10T03:53:23.313 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.310+0000 7f3be860e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T03:53:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.355+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6eec2823-c193-4222-947f-e73ba05c73ab", "id": 6} v 0) -- 0x7fa6a8073870 con 0x7fa6a806c8d0 2024-05-10T03:53:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.359+0000 7fa6a4ff9640 1 -- 172.21.15.64:0/3230786576 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6eec2823-c193-4222-947f-e73ba05c73ab", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa6980035f0 con 0x7fa6a806c8d0 2024-05-10T03:53:23.362 INFO:teuthology.orchestra.run.smithi064.stdout:6 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6a806c8d0 msgr2=0x7fa6a8146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6a806c8d0 0x7fa6a8146f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c460 tx=0x7fa69800c920 comp rx=0 tx=0).stop 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 shutdown_connections 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6a8148c20 0x7fa6a80b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6a81487a0 0x7fa6a815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 --2- 172.21.15.64:0/3230786576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6a806c8d0 0x7fa6a8146f60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.360+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 >> 172.21.15.64:0/3230786576 conn(0x7fa6a80b3dd0 msgr2=0x7fa6a80d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.361+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 shutdown_connections 2024-05-10T03:53:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.361+0000 7fa6ae5f7640 1 -- 172.21.15.64:0/3230786576 wait complete. 2024-05-10T03:53:23.374 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new a46cc402-82d1-408b-9db1-204435003db1 7 2024-05-10T03:53:23.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.473+0000 7f167122a640 1 Processor -- start 2024-05-10T03:53:23.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.473+0000 7f167122a640 1 -- start start 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f167122a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f166c1487a0 0x7f166c148c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f167122a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0b5e10 con 0x7f166c073f40 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f167122a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c1630f0 con 0x7f166c06caa0 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f167122a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f166c074720 con 0x7f166c1487a0 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f166ad9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f166c1487a0 0x7f166c148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f166ad9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f166c1487a0 0x7f166c148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46600/0 (socket says 172.21.15.64:46600) 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f166ad9d640 1 -- 172.21.15.64:0/14208388 learned_addr learned my addr 172.21.15.64:0/14208388 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f166ad9d640 1 -- 172.21.15.64:0/14208388 >> v1:172.21.15.64:6789/0 conn(0x7f166c06caa0 legacy=0x7f166c070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.477 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f166ad9d640 1 -- 172.21.15.64:0/14208388 >> v1:172.21.15.55:6789/0 conn(0x7f166c073f40 legacy=0x7f166c06c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.478 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.474+0000 7f166ad9d640 1 -- 172.21.15.64:0/14208388 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c1633d0 con 0x7f166c1487a0 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f166ad9d640 1 --2- 172.21.15.64:0/14208388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c148c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f165c009870 tx=0x7f165c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ffa3615a8188c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f1669d9b640 1 -- 172.21.15.64:0/14208388 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c037070 con 0x7f166c1487a0 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f1669d9b640 1 -- 172.21.15.64:0/14208388 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c02ae50 con 0x7f166c1487a0 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f1669d9b640 1 -- 172.21.15.64:0/14208388 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c032860 con 0x7f166c1487a0 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f167122a640 1 -- 172.21.15.64:0/14208388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 msgr2=0x7f166c148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f167122a640 1 --2- 172.21.15.64:0/14208388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c148c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f165c009870 tx=0x7f165c02a300 comp rx=0 tx=0).stop 2024-05-10T03:53:23.479 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.475+0000 7f167122a640 1 -- 172.21.15.64:0/14208388 shutdown_connections 2024-05-10T03:53:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.476+0000 7f167122a640 1 --2- 172.21.15.64:0/14208388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c148c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.476+0000 7f167122a640 1 -- 172.21.15.64:0/14208388 >> 172.21.15.64:0/14208388 conn(0x7f166c0b3dd0 msgr2=0x7f166c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.476+0000 7f167122a640 1 -- 172.21.15.64:0/14208388 shutdown_connections 2024-05-10T03:53:23.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.476+0000 7f167122a640 1 -- 172.21.15.64:0/14208388 wait complete. 2024-05-10T03:53:23.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.477+0000 7f167122a640 1 Processor -- start 2024-05-10T03:53:23.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.477+0000 7f167122a640 1 -- start start 2024-05-10T03:53:23.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f167122a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f166c06caa0 0x7f166c0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f167122a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 0x7f166c1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f167122a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c13eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f167122a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0743c0 con 0x7f166c06caa0 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f167122a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f166c163990 con 0x7f166c1487a0 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f167122a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f166c070f30 con 0x7f166c073f40 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 0x7f166c1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166b59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c13eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 0x7f166c1479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:37448/0 (socket says 172.21.15.64:37448) 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 -- 172.21.15.64:0/3848643208 learned_addr learned my addr 172.21.15.64:0/3848643208 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166ad9d640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f166c06caa0 0x7f166c0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 -- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 msgr2=0x7f166c13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c13eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 -- 172.21.15.64:0/3848643208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f166c06caa0 msgr2=0x7f166c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f166c06caa0 0x7f166c0b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166a59c640 1 -- 172.21.15.64:0/3848643208 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c13f090 con 0x7f166c073f40 2024-05-10T03:53:23.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.478+0000 7f166b59e640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f166a59c640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 0x7f166c1479e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f166000c480 tx=0x7f166000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600052d0 con 0x7f166c073f40 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1660005470 con 0x7f166c073f40 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c0af4f0 con 0x7f166c073f40 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660012870 con 0x7f166c073f40 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c0afab0 con 0x7f166c073f40 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1660012a10 con 0x7f166c073f40 2024-05-10T03:53:23.484 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.479+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f1660012d00 con 0x7f166c073f40 2024-05-10T03:53:23.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.480+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c06a7e0 con 0x7f166c073f40 2024-05-10T03:53:23.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.482+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f166c13f090 con 0x7f166c073f40 2024-05-10T03:53:23.493 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.491+0000 7f3be860e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T03:53:23.553 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.550+0000 7f3be860e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T03:53:23.558 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.556+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a46cc402-82d1-408b-9db1-204435003db1", "id": 7} v 0) -- 0x7f166c073870 con 0x7f166c073f40 2024-05-10T03:53:23.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.564+0000 7f16537fe640 1 -- 172.21.15.64:0/3848643208 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a46cc402-82d1-408b-9db1-204435003db1", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f16600035f0 con 0x7f166c073f40 2024-05-10T03:53:23.567 INFO:teuthology.orchestra.run.smithi064.stdout:7 2024-05-10T03:53:23.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 msgr2=0x7f166c1479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.568 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 0x7f166c1479e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f166000c480 tx=0x7f166000c940 comp rx=0 tx=0).stop 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 shutdown_connections 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f166c1487a0 0x7f166c13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f166c073f40 0x7f166c1479e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 --2- 172.21.15.64:0/3848643208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f166c06caa0 0x7f166c0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 >> 172.21.15.64:0/3848643208 conn(0x7f166c0b3dd0 msgr2=0x7f166c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 shutdown_connections 2024-05-10T03:53:23.569 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:23.565+0000 7f167122a640 1 -- 172.21.15.64:0/3848643208 wait complete. 2024-05-10T03:53:23.579 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T03:53:23.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T03:53:23.581 INFO:tasks.ceph.osd.0:Started 2024-05-10T03:53:23.581 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T03:53:23.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T03:53:23.584 INFO:tasks.ceph.osd.1:Started 2024-05-10T03:53:23.584 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T03:53:23.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T03:53:23.586 INFO:tasks.ceph.osd.2:Started 2024-05-10T03:53:23.586 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T03:53:23.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T03:53:23.589 INFO:tasks.ceph.osd.3:Started 2024-05-10T03:53:23.589 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T03:53:23.589 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T03:53:23.591 INFO:tasks.ceph.osd.4:Started 2024-05-10T03:53:23.591 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T03:53:23.591 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T03:53:23.593 INFO:tasks.ceph.osd.5:Started 2024-05-10T03:53:23.593 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T03:53:23.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T03:53:23.596 INFO:tasks.ceph.osd.6:Started 2024-05-10T03:53:23.596 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T03:53:23.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T03:53:23.598 INFO:tasks.ceph.osd.7:Started 2024-05-10T03:53:23.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:23.615 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.612+0000 7f3be860e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T03:53:23.713 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:23.710+0000 7f7b7660d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:53:23.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.721+0000 7fcb48dd4640 1 Processor -- start 2024-05-10T03:53:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.721+0000 7fcb48dd4640 1 -- start start 2024-05-10T03:53:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb48dd4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcb4415f3d0 0x7fcb440d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb48dd4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb440d2980 0x7fcb440d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb48dd4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb440d3360 0x7fcb440d3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb48dd4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fcb44160a10 con 0x7fcb440d2980 2024-05-10T03:53:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb48dd4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fcb44160450 con 0x7fcb4415f3d0 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb48dd4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcb44160730 con 0x7fcb440d3360 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb440d2980 0x7fcb440d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb440d2980 0x7fcb440d38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60596/0 (socket says 172.21.15.55:60596) 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 -- 172.21.15.55:0/933385314 learned_addr learned my addr 172.21.15.55:0/933385314 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb4259c640 1 --2- 172.21.15.55:0/933385314 >> v2:172.21.15.64:3300/0 conn(0x7fcb4415f3d0 0x7fcb440d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb42d9d640 1 --2- 172.21.15.55:0/933385314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb440d3360 0x7fcb440d3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 -- 172.21.15.55:0/933385314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb440d3360 msgr2=0x7fcb440d3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 --2- 172.21.15.55:0/933385314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb440d3360 0x7fcb440d3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 -- 172.21.15.55:0/933385314 >> v2:172.21.15.64:3300/0 conn(0x7fcb4415f3d0 msgr2=0x7fcb440d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 --2- 172.21.15.55:0/933385314 >> v2:172.21.15.64:3300/0 conn(0x7fcb4415f3d0 0x7fcb440d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.722+0000 7fcb41d9b640 1 -- 172.21.15.55:0/933385314 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb440d1c40 con 0x7fcb440d2980 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.723+0000 7fcb41d9b640 1 --2- 172.21.15.55:0/933385314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d2980 0x7fcb440d38a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb4408f4b0 tx=0x7fcb3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897949a6cdc1d62f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.723+0000 7fcb4159a640 1 -- 172.21.15.55:0/933385314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037070 con 0x7fcb440d2980 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.723+0000 7fcb4159a640 1 -- 172.21.15.55:0/933385314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38032440 con 0x7fcb440d2980 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.723+0000 7fcb4159a640 1 -- 172.21.15.55:0/933385314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38032810 con 0x7fcb440d2980 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 -- 172.21.15.55:0/933385314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d2980 msgr2=0x7fcb440d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/933385314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d2980 0x7fcb440d38a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb4408f4b0 tx=0x7fcb3802a1e0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 -- 172.21.15.55:0/933385314 shutdown_connections 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/933385314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb440d3360 0x7fcb440d3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/933385314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d2980 0x7fcb440d38a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/933385314 >> v2:172.21.15.64:3300/0 conn(0x7fcb4415f3d0 0x7fcb440d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 -- 172.21.15.55:0/933385314 >> 172.21.15.55:0/933385314 conn(0x7fcb4408ed00 msgr2=0x7fcb4409e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 -- 172.21.15.55:0/933385314 shutdown_connections 2024-05-10T03:53:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.724+0000 7fcb48dd4640 1 -- 172.21.15.55:0/933385314 wait complete. 2024-05-10T03:53:23.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.725+0000 7fcb48dd4640 1 Processor -- start 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.725+0000 7fcb48dd4640 1 -- start start 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb48dd4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 0x7fcb44161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb48dd4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb4415f3d0 0x7fcb44162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb48dd4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb4415d920 0x7fcb440cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb48dd4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcb440b50e0 con 0x7fcb440d3360 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb48dd4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcb440b4f60 con 0x7fcb4415f3d0 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb48dd4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcb440b5260 con 0x7fcb4415d920 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb4259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 0x7fcb44161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb4259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 0x7fcb44161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60602/0 (socket says 172.21.15.55:60602) 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb4259c640 1 -- 172.21.15.55:0/775303953 learned_addr learned my addr 172.21.15.55:0/775303953 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb42d9d640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb4415d920 0x7fcb440cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.726+0000 7fcb41d9b640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb4415f3d0 0x7fcb44162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb4259c640 1 -- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb4415d920 msgr2=0x7fcb440cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb4259c640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb4415d920 0x7fcb440cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb4259c640 1 -- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb4415f3d0 msgr2=0x7fcb44162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb4259c640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb4415f3d0 0x7fcb44162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb4259c640 1 -- 172.21.15.55:0/775303953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb440cd1c0 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb4259c640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 0x7fcb44161e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400e8a0 tx=0x7fcb3400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34017070 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3400c940 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb440cd4a0 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400cd30 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb440cda60 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcb3401a070 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.727+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcb3401cb20 con 0x7fcb440d3360 2024-05-10T03:53:23.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.728+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb440a3290 con 0x7fcb440d3360 2024-05-10T03:53:23.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.730+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcb3401c450 con 0x7fcb440d3360 2024-05-10T03:53:23.763 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:23.760+0000 7f3be860e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T03:53:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.794+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb440cbc40 con 0x7fcb440d3360 2024-05-10T03:53:23.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.794+0000 7fcb32ffd640 1 -- 172.21.15.55:0/775303953 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fcb3401c630 con 0x7fcb440d3360 2024-05-10T03:53:23.797 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:23.797 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:23.558328+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 msgr2=0x7fcb44161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 0x7fcb44161e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400e8a0 tx=0x7fcb3400ed60 comp rx=0 tx=0).stop 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 shutdown_connections 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb4415d920 0x7fcb440cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb4415f3d0 0x7fcb44162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 --2- 172.21.15.55:0/775303953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb440d3360 0x7fcb44161e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 >> 172.21.15.55:0/775303953 conn(0x7fcb4408ed00 msgr2=0x7fcb4415e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 shutdown_connections 2024-05-10T03:53:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:23.795+0000 7fcb48dd4640 1 -- 172.21.15.55:0/775303953 wait complete. 2024-05-10T03:53:23.809 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T03:53:23.809 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T03:53:23.862 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:23.859+0000 7f7b7660d040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T03:53:24.134 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.131+0000 7f7b7660d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:53:24.164 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:24.162+0000 7f3be860e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T03:53:24.188 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.186+0000 7f7b7660d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:53:24.203 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-10T03:53:24.200+0000 7f3ba5414640 -1 Falling back to public interface 2024-05-10T03:53:24.204 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-05-10T03:53:24.202+0000 7f424101a640 -1 Falling back to public interface 2024-05-10T03:53:24.211 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-10T03:53:24.208+0000 7fc733c22640 -1 Falling back to public interface 2024-05-10T03:53:24.212 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-10T03:53:24.209+0000 7fa1213cb640 -1 Falling back to public interface 2024-05-10T03:53:24.212 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-05-10T03:53:24.210+0000 7f4928232640 -1 Falling back to public interface 2024-05-10T03:53:24.212 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-05-10T03:53:24.210+0000 7f1d7b820640 -1 Falling back to public interface 2024-05-10T03:53:24.217 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-10T03:53:24.214+0000 7f45a1086640 -1 Falling back to public interface 2024-05-10T03:53:24.225 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-05-10T03:53:24.224+0000 7f9b69c0c640 -1 Falling back to public interface 2024-05-10T03:53:24.313 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.310+0000 7f7b7660d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:53:24.314 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:24.312+0000 7f3be860e040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T03:53:24.589 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:24.587+0000 7f3be860e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T03:53:24.614 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:24.615 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.613+0000 7f7b7660d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:53:24.644 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:24.642+0000 7f3be860e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T03:53:24.667 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.665+0000 7f7b7660d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:53:24.709 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.706+0000 7f0535de5640 1 Processor -- start 2024-05-10T03:53:24.709 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.706+0000 7f0535de5640 1 -- start start 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f0535de5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0530148260 0x7f053006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f0535de5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0530163f30 con 0x7f05300c9200 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f0535de5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0530148640 con 0x7f05301488a0 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f0535de5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0530072cc0 con 0x7f0530148260 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f05300c9200 0x7f0530163820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60246/0 (socket says 172.21.15.55:60246) 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052ffff640 1 -- 172.21.15.55:0/2961892801 learned_addr learned my addr 172.21.15.55:0/2961892801 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052f7fe640 1 --2- 172.21.15.55:0/2961892801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0530148260 0x7f053006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954407801 0 0) 0x7f0530163f30 con 0x7f05300c9200 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0518003520 con 0x7f05300c9200 2024-05-10T03:53:24.716 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213270329 0 0) 0x7f0530148640 con 0x7f05301488a0 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0530163f30 con 0x7f05301488a0 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052f7fe640 1 -- 172.21.15.55:0/2961892801 >> v1:172.21.15.64:6789/0 conn(0x7f05301488a0 legacy=0x7f0530163110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052f7fe640 1 -- 172.21.15.55:0/2961892801 >> v1:172.21.15.55:6789/0 conn(0x7f05300c9200 legacy=0x7f0530163820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.707+0000 7f052f7fe640 1 -- 172.21.15.55:0/2961892801 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0530071dd0 con 0x7f0530148260 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.708+0000 7f052f7fe640 1 --2- 172.21.15.55:0/2961892801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0530148260 0x7f053006d3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f05200097d0 tx=0x7f052002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d816cc66224621 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.708+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520037070 con 0x7f0530148260 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.708+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0520032440 con 0x7f0530148260 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.708+0000 7f052e7fc640 1 -- 172.21.15.55:0/2961892801 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05200327f0 con 0x7f0530148260 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 -- 172.21.15.55:0/2961892801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0530148260 msgr2=0x7f053006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 --2- 172.21.15.55:0/2961892801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0530148260 0x7f053006d3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f05200097d0 tx=0x7f052002a210 comp rx=0 tx=0).stop 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 -- 172.21.15.55:0/2961892801 shutdown_connections 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 --2- 172.21.15.55:0/2961892801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0530148260 0x7f053006d3e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 -- 172.21.15.55:0/2961892801 >> 172.21.15.55:0/2961892801 conn(0x7f05300cfb90 msgr2=0x7f05300cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 -- 172.21.15.55:0/2961892801 shutdown_connections 2024-05-10T03:53:24.717 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.709+0000 7f0535de5640 1 -- 172.21.15.55:0/2961892801 wait complete. 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.710+0000 7f0535de5640 1 Processor -- start 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.710+0000 7f0535de5640 1 -- start start 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f0535de5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 0x7f05300b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f0535de5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 0x7f05300b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f0535de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 0x7f0530133880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f0535de5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0530072670 con 0x7f05301488a0 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f0535de5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0530072390 con 0x7f0530148260 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f0535de5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0530072950 con 0x7f05300c9200 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 0x7f05300b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 0x7f0530133880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 0x7f05300b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 0x7f05300b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:57412/0 (socket says 172.21.15.55:57412) 2024-05-10T03:53:24.718 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 0x7f0530133880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60608/0 (socket says 172.21.15.55:60608) 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 0x7f05300b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:59924/0 (socket says 172.21.15.55:59924) 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052effd640 1 -- 172.21.15.55:0/1922203800 learned_addr learned my addr 172.21.15.55:0/1922203800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 -- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 msgr2=0x7f05300b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 0x7f05300b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 -- 172.21.15.55:0/1922203800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 msgr2=0x7f0530133880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 0x7f0530133880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.711+0000 7f052f7fe640 1 -- 172.21.15.55:0/1922203800 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05300b3cc0 con 0x7f05300c9200 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f052effd640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 0x7f05300b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f052ffff640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 0x7f0530133880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f052f7fe640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 0x7f05300b62f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0520031000 tx=0x7f05200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520041030 con 0x7f05300c9200 2024-05-10T03:53:24.719 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052003d420 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05300b3fa0 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520037040 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05300b4560 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0520044070 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.712+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0520003ce0 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.713+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053006f3a0 con 0x7f05300c9200 2024-05-10T03:53:24.720 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.717+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f053006f3a0 con 0x7f05300c9200 2024-05-10T03:53:24.769 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:24.767+0000 7f3be860e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T03:53:24.785 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.780+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0530071bc0 con 0x7f05300c9200 2024-05-10T03:53:24.785 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.781+0000 7f0517fff640 1 -- 172.21.15.55:0/1922203800 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f052004b020 con 0x7f05300c9200 2024-05-10T03:53:24.786 INFO:teuthology.misc.health.smithi055.stdout: 2024-05-10T03:53:24.786 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:23.558328+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 msgr2=0x7f05300b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 0x7f05300b62f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0520031000 tx=0x7f05200046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 shutdown_connections 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05301488a0 0x7f0530133880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0530148260 0x7f05300b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 --2- 172.21.15.55:0/1922203800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05300c9200 0x7f05300b62f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 >> 172.21.15.55:0/1922203800 conn(0x7f05300cfb90 msgr2=0x7f05300d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 shutdown_connections 2024-05-10T03:53:24.787 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:24.782+0000 7f0535de5640 1 -- 172.21.15.55:0/1922203800 wait complete. 2024-05-10T03:53:24.794 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T03:53:24.835 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.833+0000 7f7b7660d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:53:24.979 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:24.977+0000 7f7b7660d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:53:25.031 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:25.029+0000 7f7b7660d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:53:25.075 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.073+0000 7f3be860e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T03:53:25.105 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:25.102+0000 7f7b7660d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:53:25.125 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.123+0000 7f3be860e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T03:53:25.152 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:25.150+0000 7f7b7660d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:53:25.289 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.287+0000 7f3be860e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T03:53:25.435 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.434+0000 7f3be860e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T03:53:25.488 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.486+0000 7f3be860e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T03:53:25.561 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.559+0000 7f3be860e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T03:53:25.609 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:25.607+0000 7f3be860e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T03:53:25.653 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:25.651+0000 7f7b7660d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:53:25.774 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:25.772+0000 7f7b7660d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:53:26.114 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:26.112+0000 7f3be860e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T03:53:26.236 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-05-10T03:53:26.234+0000 7f3be860e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T03:53:26.792 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:26.789+0000 7f7b15c8e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T03:53:26.792 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-10T03:53:26.789+0000 7f7b15c8e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T03:53:27.693 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-05-10T03:53:27.691+0000 7f1d7b820640 -1 osd.4 0 log_to_monitors true 2024-05-10T03:53:27.698 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-05-10T03:53:27.696+0000 7f4928232640 -1 osd.5 0 log_to_monitors true 2024-05-10T03:53:27.726 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-10T03:53:27.724+0000 7f3ba5414640 -1 osd.2 0 log_to_monitors true 2024-05-10T03:53:27.729 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-05-10T03:53:27.727+0000 7f424101a640 -1 osd.7 0 log_to_monitors true 2024-05-10T03:53:27.734 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-10T03:53:27.732+0000 7fa1213cb640 -1 osd.1 0 log_to_monitors true 2024-05-10T03:53:27.744 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-10T03:53:27.742+0000 7f45a1086640 -1 osd.0 0 log_to_monitors true 2024-05-10T03:53:27.745 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-10T03:53:27.742+0000 7fc733c22640 -1 osd.3 0 log_to_monitors true 2024-05-10T03:53:27.746 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-05-10T03:53:27.745+0000 7f9b69c0c640 -1 osd.6 0 log_to_monitors true 2024-05-10T03:53:30.881 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-05-10T03:53:30.878+0000 7f49249dc640 -1 osd.5 0 waiting for initial osdmap 2024-05-10T03:53:30.893 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-05-10T03:53:30.890+0000 7f491bfe8640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:30.933 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-05-10T03:53:30.930+0000 7f1d7792b640 -1 osd.4 0 waiting for initial osdmap 2024-05-10T03:53:30.942 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-05-10T03:53:30.940+0000 7f1d6ef37640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:30.956 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-05-10T03:53:30.953+0000 7f9b65639640 -1 osd.6 0 waiting for initial osdmap 2024-05-10T03:53:30.959 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-05-10T03:53:30.956+0000 7f423c9e7640 -1 osd.7 0 waiting for initial osdmap 2024-05-10T03:53:30.971 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-05-10T03:53:30.968+0000 7f9b5d459640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:30.975 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-05-10T03:53:30.973+0000 7f4234807640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:31.211 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-10T03:53:31.208+0000 7fa11d361640 -1 osd.1 0 waiting for initial osdmap 2024-05-10T03:53:31.221 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-10T03:53:31.217+0000 7fc72f615640 -1 osd.3 0 waiting for initial osdmap 2024-05-10T03:53:31.226 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-10T03:53:31.222+0000 7f459d01c640 -1 osd.0 0 waiting for initial osdmap 2024-05-10T03:53:31.228 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-10T03:53:31.225+0000 7fa115181640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:31.232 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-10T03:53:31.229+0000 7fc727435640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:31.240 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-10T03:53:31.236+0000 7f4594e3c640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:31.247 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-10T03:53:31.244+0000 7f3ba0e2a640 -1 osd.2 0 waiting for initial osdmap 2024-05-10T03:53:31.264 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-10T03:53:31.261+0000 7f3b98c4a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T03:53:31.600 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:31.696 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.693+0000 7f67edce8640 1 Processor -- start 2024-05-10T03:53:31.697 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.693+0000 7f67edce8640 1 -- start start 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67edce8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e806daf0 0x7f67e80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67edce8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e8142820 con 0x7f67e8142440 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67edce8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e8142f70 con 0x7f67e8142b00 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67edce8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f67e8144b90 con 0x7f67e806daf0 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67e8142440 0x7f67e81638d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43116/0 (socket says 172.21.15.55:43116) 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e77fe640 1 -- 172.21.15.55:0/600521030 learned_addr learned my addr 172.21.15.55:0/600521030 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e7fff640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e806daf0 0x7f67e80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765412219 0 0) 0x7f67d8001110 con 0x7f67e8142440 2024-05-10T03:53:31.700 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d0003520 con 0x7f67e8142440 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262380846 0 0) 0x7f67e8142f70 con 0x7f67e8142b00 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d8001110 con 0x7f67e8142b00 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1181843690 0 0) 0x7f67d0003520 con 0x7f67e8142440 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e806daf0 msgr2=0x7f67e80b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e806daf0 0x7f67e80b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 >> v1:172.21.15.64:6789/0 conn(0x7f67e8142b00 legacy=0x7f67e806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e8144e70 con 0x7f67e8142440 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f67d80018c0 con 0x7f67e8142440 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 >> v1:172.21.15.55:6789/0 conn(0x7f67e8142440 legacy=0x7f67e81638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67d0003c10 0x7f67d0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67d00051c0 0x7f67d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8144b90 con 0x7f67d0004800 2024-05-10T03:53:31.701 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f67d000c090 con 0x7f67d00051c0 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f67d000c290 con 0x7f67d0003c10 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e7fff640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e806daf0 0x7f67e80b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.694+0000 7f67e77fe640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67d0003c10 0x7f67d0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e7fff640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67d00051c0 0x7f67d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e6ffd640 1 -- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67d0003c10 msgr2=0x7f67d0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67d0003c10 0x7f67d0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e6ffd640 1 -- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67d00051c0 msgr2=0x7f67d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67d00051c0 0x7f67d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e6ffd640 1 -- 172.21.15.55:0/600521030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0003520 con 0x7f67d0004800 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.695+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0018a0 tx=0x7f67d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08759c86a14a1c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0014c0 con 0x7f67d0004800 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc02acf0 con 0x7f67d0004800 2024-05-10T03:53:31.702 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67e67fc640 1 -- 172.21.15.55:0/600521030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc005310 con 0x7f67d0004800 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67edce8640 1 -- 172.21.15.55:0/600521030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 msgr2=0x7f67d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67edce8640 1 --2- 172.21.15.55:0/600521030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67d0004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0018a0 tx=0x7f67d0005830 comp rx=0 tx=0).stop 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67e7fff640 1 -- 172.21.15.55:0/600521030 reap_dead start 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67edce8640 1 -- 172.21.15.55:0/600521030 shutdown_connections 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67edce8640 1 -- 172.21.15.55:0/600521030 >> 172.21.15.55:0/600521030 conn(0x7f67e80d30a0 msgr2=0x7f67e80d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67edce8640 1 -- 172.21.15.55:0/600521030 shutdown_connections 2024-05-10T03:53:31.703 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.696+0000 7f67edce8640 1 -- 172.21.15.55:0/600521030 wait complete. 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.697+0000 7f67edce8640 1 Processor -- start 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 -- start start 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67e81e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67e815bbb0 0x7f67e81e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e815c030 0x7f67e81ea070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8145710 con 0x7f67d0004800 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8145430 con 0x7f67e815bbb0 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67edce8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f67e81459f0 con 0x7f67e815c030 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67e81e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67e81e91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47532/0 (socket says 172.21.15.55:47532) 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.698+0000 7f67e77fe640 1 -- 172.21.15.55:0/3296761132 learned_addr learned my addr 172.21.15.55:0/3296761132 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e7fff640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e815c030 0x7f67e81ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.706 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67e815bbb0 0x7f67e81e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e77fe640 1 -- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e815c030 msgr2=0x7f67e81ea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e77fe640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e815c030 0x7f67e81ea070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e77fe640 1 -- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67e815bbb0 msgr2=0x7f67e81e9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e77fe640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67e815bbb0 0x7f67e81e9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e77fe640 1 -- 172.21.15.55:0/3296761132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e81e96e0 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67e77fe640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67e81e91a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001a30 tx=0x7f67d8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d800fa80 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d8018070 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e815ca60 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d800fe60 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.699+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e815b3b0 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.700+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e80c9ee0 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.701+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f67d801d460 con 0x7f67d0004800 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.701+0000 7f67cffff640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67d4076270 0x7f67d4078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:31.707 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.701+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67d4076270 0x7f67d4078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:31.708 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.702+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f67d80968b0 con 0x7f67d0004800 2024-05-10T03:53:31.708 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.702+0000 7f67e6ffd640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67d4076270 0x7f67d4078730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0018a0 tx=0x7f67dc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:31.710 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.706+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f67e80c9ee0 con 0x7f67d0004800 2024-05-10T03:53:31.911 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.907+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67e81e9910 con 0x7f67d0004800 2024-05-10T03:53:31.911 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.908+0000 7f67cffff640 1 -- 172.21.15.55:0/3296761132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10813 (secure 0 0 0) 0x7f67e8142820 con 0x7f67d0004800 2024-05-10T03:53:31.911 INFO:teuthology.misc.health.smithi055.stdout: 2024-05-10T03:53:31.911 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":13,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:31.881041+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:31.913 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67d4076270 msgr2=0x7f67d4078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67d4076270 0x7f67d4078730 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0018a0 tx=0x7f67dc02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 msgr2=0x7f67e81e91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67e81e91a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001a30 tx=0x7f67d8007720 comp rx=0 tx=0).stop 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 shutdown_connections 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f67e815c030 0x7f67e81ea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67e815bbb0 0x7f67e81e9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67d4076270 0x7f67d4078730 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 --2- 172.21.15.55:0/3296761132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67d0004800 0x7f67e81e91a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 >> 172.21.15.55:0/3296761132 conn(0x7f67e80d30a0 msgr2=0x7f67e8162380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 shutdown_connections 2024-05-10T03:53:31.914 INFO:teuthology.misc.health.smithi055.stderr:2024-05-10T03:53:31.910+0000 7f67edce8640 1 -- 172.21.15.55:0/3296761132 wait complete. 2024-05-10T03:53:31.923 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T03:53:31.923 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T03:53:31.924 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T03:53:31.924 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T03:53:31.926 INFO:tasks.ceph.mds.a:Started 2024-05-10T03:53:31.926 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T03:53:31.926 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T03:53:31.928 INFO:tasks.ceph.mds.c:Started 2024-05-10T03:53:31.928 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T03:53:31.928 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T03:53:31.931 INFO:tasks.ceph.mds.b:Started 2024-05-10T03:53:31.931 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T03:53:31.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T03:53:31.934 INFO:tasks.ceph.mds.d:Started 2024-05-10T03:53:31.934 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-10T03:53:31.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:53:32.005 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-05-10T03:53:32.005 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-05-10T03:53:32.006 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-05-10T03:53:32.002+0000 7fcd55c30640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T03:53:32.023 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2024-05-10T03:53:32.023 INFO:tasks.ceph.mds.d.smithi064.stdout:starting mds.d at 2024-05-10T03:53:32.024 INFO:tasks.ceph.mds.b.smithi064.stderr:2024-05-10T03:53:32.021+0000 7f02166cd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-10T03:53:32.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.040+0000 7fb6e2093640 1 Processor -- start 2024-05-10T03:53:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.040+0000 7fb6e2093640 1 -- start start 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6e2093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6dc0d2b80 0x7fb6dc15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6e2093640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc160370 0x7fb6dc0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6e2093640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc163100 con 0x7fb6dc070e00 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6e2093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fb6dc163370 con 0x7fb6dc0d2b80 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6e2093640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc163650 con 0x7fb6dc160370 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6daffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6dc0d2b80 0x7fb6dc15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6db7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb6dc070e00 0x7fb6dc0d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43132/0 (socket says 172.21.15.55:43132) 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6db7fe640 1 -- 172.21.15.55:0/1857903216 learned_addr learned my addr 172.21.15.55:0/1857903216 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6dbfff640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc160370 0x7fb6dc0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6daffd640 1 -- 172.21.15.55:0/1857903216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc160370 msgr2=0x7fb6dc0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:32.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6daffd640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc160370 0x7fb6dc0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6daffd640 1 -- 172.21.15.55:0/1857903216 >> v1:172.21.15.55:6789/0 conn(0x7fb6dc070e00 legacy=0x7fb6dc0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:32.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6daffd640 1 -- 172.21.15.55:0/1857903216 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc163930 con 0x7fb6dc0d2b80 2024-05-10T03:53:32.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6da7fc640 1 -- 172.21.15.55:0/1857903216 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009056116 0 0) 0x7fb6dc163100 con 0x7fb6dc070e00 2024-05-10T03:53:32.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.041+0000 7fb6dbfff640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc160370 0x7fb6dc0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.042+0000 7fb6daffd640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc15fe30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097a0 tx=0x7fb6d002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f33a39cf1ce81f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.042+0000 7fb6da7fc640 1 -- 172.21.15.55:0/1857903216 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0037070 con 0x7fb6dc0d2b80 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.042+0000 7fb6da7fc640 1 -- 172.21.15.55:0/1857903216 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d002ae50 con 0x7fb6dc0d2b80 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.042+0000 7fb6da7fc640 1 -- 172.21.15.55:0/1857903216 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0032660 con 0x7fb6dc0d2b80 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 -- 172.21.15.55:0/1857903216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc0d2b80 msgr2=0x7fb6dc15fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc15fe30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097a0 tx=0x7fb6d002a100 comp rx=0 tx=0).stop 2024-05-10T03:53:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 -- 172.21.15.55:0/1857903216 shutdown_connections 2024-05-10T03:53:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc160370 0x7fb6dc0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 --2- 172.21.15.55:0/1857903216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc15fe30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 -- 172.21.15.55:0/1857903216 >> 172.21.15.55:0/1857903216 conn(0x7fb6dc06f940 msgr2=0x7fb6dc06fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 -- 172.21.15.55:0/1857903216 shutdown_connections 2024-05-10T03:53:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.043+0000 7fb6e2093640 1 -- 172.21.15.55:0/1857903216 wait complete. 2024-05-10T03:53:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.044+0000 7fb6e2093640 1 Processor -- start 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.044+0000 7fb6e2093640 1 -- start start 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6e2093640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc070e00 0x7fb6dc145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6e2093640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6e2093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 0x7fb6dc0b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6e2093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc160980 con 0x7fb6dc160370 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6e2093640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc160800 con 0x7fb6dc0d2b80 2024-05-10T03:53:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6e2093640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc073810 con 0x7fb6dc070e00 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 0x7fb6dc0b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 0x7fb6dc0b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47570/0 (socket says 172.21.15.55:47570) 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 -- 172.21.15.55:0/4007317122 learned_addr learned my addr 172.21.15.55:0/4007317122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6db7fe640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc070e00 0x7fb6dc145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6daffd640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 -- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc070e00 msgr2=0x7fb6dc145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc070e00 0x7fb6dc145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 -- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6dc0d2b80 msgr2=0x7fb6dc0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 -- 172.21.15.55:0/4007317122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc153310 con 0x7fb6dc160370 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.045+0000 7fb6dbfff640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 0x7fb6dc0b20f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4007df0 tx=0x7fb6d400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.046+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d401a070 con 0x7fb6dc160370 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.046+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4003990 con 0x7fb6dc160370 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.046+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc1f6650 con 0x7fb6dc160370 2024-05-10T03:53:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.046+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4003d80 con 0x7fb6dc160370 2024-05-10T03:53:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.046+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc1f8e20 con 0x7fb6dc160370 2024-05-10T03:53:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.047+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6bc005290 con 0x7fb6dc160370 2024-05-10T03:53:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.047+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fb6d401d070 con 0x7fb6dc160370 2024-05-10T03:53:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.048+0000 7fb6c3fff640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb6c8076240 0x7fb6c8078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.048+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fb6d4097120 con 0x7fb6dc160370 2024-05-10T03:53:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.048+0000 7fb6db7fe640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb6c8076240 0x7fb6c8078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.048+0000 7fb6db7fe640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb6c8076240 0x7fb6c8078700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000f60 tx=0x7fb6cc007cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.052+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6dc1f6650 con 0x7fb6dc160370 2024-05-10T03:53:32.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.282+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6bc005580 con 0x7fb6dc160370 2024-05-10T03:53:32.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.282+0000 7fb6c3fff640 1 -- 172.21.15.55:0/4007317122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fb6dc153310 con 0x7fb6dc160370 2024-05-10T03:53:32.286 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:32.286 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-10T03:53:32.286 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 2 2024-05-10T03:53:32.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb6c8076240 msgr2=0x7fb6c8078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:32.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb6c8076240 0x7fb6c8078700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc000f60 tx=0x7fb6cc007cf0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 msgr2=0x7fb6dc0b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 0x7fb6dc0b20f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4007df0 tx=0x7fb6d400d4a0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 shutdown_connections 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb6c8076240 0x7fb6c8078700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6dc160370 0x7fb6dc0b20f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6dc0d2b80 0x7fb6dc0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 --2- 172.21.15.55:0/4007317122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6dc070e00 0x7fb6dc145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 >> 172.21.15.55:0/4007317122 conn(0x7fb6dc06f940 msgr2=0x7fb6dc0d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 shutdown_connections 2024-05-10T03:53:32.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:32.284+0000 7fb6e2093640 1 -- 172.21.15.55:0/4007317122 wait complete. 2024-05-10T03:53:34.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:53:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.412+0000 7f5a2ae83640 1 Processor -- start 2024-05-10T03:53:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.412+0000 7f5a2ae83640 1 -- start start 2024-05-10T03:53:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a2ae83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a2415f5e0 0x7f5a240d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a2ae83640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5a240b4ed0 0x7f5a240d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a2ae83640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a240d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a2ae83640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f5a240d42b0 con 0x7f5a2415f5e0 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a2ae83640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f5a240d58e0 con 0x7f5a240b4ed0 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a2ae83640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5a240b6250 con 0x7f5a240d5450 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a28c1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a2415f5e0 0x7f5a240d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a28c1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a2415f5e0 0x7f5a240d3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47574/0 (socket says 172.21.15.55:47574) 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.413+0000 7f5a28c1f640 1 -- 172.21.15.55:0/513847634 learned_addr learned my addr 172.21.15.55:0/513847634 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a29420640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a240d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a23fff640 1 --2- 172.21.15.55:0/513847634 >> v2:172.21.15.64:3300/0 conn(0x7f5a240b4ed0 0x7f5a240d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a28c1f640 1 -- 172.21.15.55:0/513847634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 msgr2=0x7f5a240d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a28c1f640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a240d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a28c1f640 1 -- 172.21.15.55:0/513847634 >> v2:172.21.15.64:3300/0 conn(0x7f5a240b4ed0 msgr2=0x7f5a240d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a28c1f640 1 --2- 172.21.15.55:0/513847634 >> v2:172.21.15.64:3300/0 conn(0x7f5a240b4ed0 0x7f5a240d4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a28c1f640 1 -- 172.21.15.55:0/513847634 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a240b5640 con 0x7f5a2415f5e0 2024-05-10T03:53:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a29420640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a240d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.414+0000 7f5a23fff640 1 --2- 172.21.15.55:0/513847634 >> v2:172.21.15.64:3300/0 conn(0x7f5a240b4ed0 0x7f5a240d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a28c1f640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a240d3d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a2408ec00 tx=0x7f5a1c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f241f889c94aa9c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a237fe640 1 -- 172.21.15.55:0/513847634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c036070 con 0x7f5a2415f5e0 2024-05-10T03:53:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a237fe640 1 -- 172.21.15.55:0/513847634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c031600 con 0x7f5a2415f5e0 2024-05-10T03:53:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a237fe640 1 -- 172.21.15.55:0/513847634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0319d0 con 0x7f5a2415f5e0 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 -- 172.21.15.55:0/513847634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 msgr2=0x7f5a240d3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a240d3d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a2408ec00 tx=0x7f5a1c02a6a0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 -- 172.21.15.55:0/513847634 shutdown_connections 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/513847634 >> v2:172.21.15.64:3300/0 conn(0x7f5a240b4ed0 0x7f5a240d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a240d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/513847634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a240d3d70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 -- 172.21.15.55:0/513847634 >> 172.21.15.55:0/513847634 conn(0x7f5a2408ec70 msgr2=0x7f5a2409e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 -- 172.21.15.55:0/513847634 shutdown_connections 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.415+0000 7f5a2ae83640 1 -- 172.21.15.55:0/513847634 wait complete. 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.417+0000 7f5a2ae83640 1 Processor -- start 2024-05-10T03:53:34.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.417+0000 7f5a2ae83640 1 -- start start 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a240b4ed0 0x7f5a240ba800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a2415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a241615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5a240b5ee0 con 0x7f5a2415f5e0 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5a240b5c00 con 0x7f5a240b4ed0 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5a240b5330 con 0x7f5a240d5450 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a241615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a241615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47578/0 (socket says 172.21.15.55:47578) 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 -- 172.21.15.55:0/1152156915 learned_addr learned my addr 172.21.15.55:0/1152156915 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a23fff640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a2415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a28c1f640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a240b4ed0 0x7f5a240ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 -- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 msgr2=0x7f5a2415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a2415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 -- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a240b4ed0 msgr2=0x7f5a240ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a240b4ed0 0x7f5a240ba800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 -- 172.21.15.55:0/1152156915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a240b8340 con 0x7f5a2415f5e0 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a29420640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a241615c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c820 tx=0x7f5a1400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14015070 con 0x7f5a2415f5e0 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a14007a30 con 0x7f5a2415f5e0 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.418+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a240cb320 con 0x7f5a2415f5e0 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.419+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007e20 con 0x7f5a2415f5e0 2024-05-10T03:53:34.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.419+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a240b85e0 con 0x7f5a2415f5e0 2024-05-10T03:53:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.420+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a240d5b70 con 0x7f5a2415f5e0 2024-05-10T03:53:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.420+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f5a14018070 con 0x7f5a2415f5e0 2024-05-10T03:53:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.421+0000 7f5a217fa640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5a10076240 0x7f5a10078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.421+0000 7f5a28c1f640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5a10076240 0x7f5a10078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.421+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f5a14096f80 con 0x7f5a2415f5e0 2024-05-10T03:53:34.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.421+0000 7f5a28c1f640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5a10076240 0x7f5a10078700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c033000 tx=0x7f5a1c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:34.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.426+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a240d5b70 con 0x7f5a2415f5e0 2024-05-10T03:53:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.656+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a240a3270 con 0x7f5a2415f5e0 2024-05-10T03:53:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.657+0000 7f5a217fa640 1 -- 172.21.15.55:0/1152156915 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f5a14060760 con 0x7f5a2415f5e0 2024-05-10T03:53:34.661 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:34.661 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-10T03:53:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5a10076240 msgr2=0x7f5a10078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5a10076240 0x7f5a10078700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c033000 tx=0x7f5a1c009000 comp rx=0 tx=0).stop 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 msgr2=0x7f5a241615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a241615c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c820 tx=0x7f5a1400cce0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 shutdown_connections 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5a10076240 0x7f5a10078700 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a2415f5e0 0x7f5a241615c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a240d5450 0x7f5a2415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 --2- 172.21.15.55:0/1152156915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a240b4ed0 0x7f5a240ba800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 >> 172.21.15.55:0/1152156915 conn(0x7f5a2408ec70 msgr2=0x7f5a2406dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 shutdown_connections 2024-05-10T03:53:34.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.659+0000 7f5a2ae83640 1 -- 172.21.15.55:0/1152156915 wait complete. 2024-05-10T03:53:34.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T03:53:34.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.777+0000 7f8625e59640 1 Processor -- start 2024-05-10T03:53:34.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.777+0000 7f8625e59640 1 -- start start 2024-05-10T03:53:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f8625e59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f862015f450 0x7f86200cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f8625e59640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f862015f830 0x7f86200b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f8625e59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86200b5da0 con 0x7f86200d03b0 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f8625e59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f8620163460 con 0x7f862015f450 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f8625e59640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f86200b6080 con 0x7f862015f830 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f862015f450 0x7f86200cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86200d03b0 0x7f86200d5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43138/0 (socket says 172.21.15.55:43138) 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861ffff640 1 -- 172.21.15.55:0/3465242264 learned_addr learned my addr 172.21.15.55:0/3465242264 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861effd640 1 --2- 172.21.15.55:0/3465242264 >> v2:172.21.15.64:3300/0 conn(0x7f862015f830 0x7f86200b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861f7fe640 1 -- 172.21.15.55:0/3465242264 >> v2:172.21.15.64:3300/0 conn(0x7f862015f830 msgr2=0x7f86200b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861f7fe640 1 --2- 172.21.15.55:0/3465242264 >> v2:172.21.15.64:3300/0 conn(0x7f862015f830 0x7f86200b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861f7fe640 1 -- 172.21.15.55:0/3465242264 >> v1:172.21.15.55:6789/0 conn(0x7f86200d03b0 legacy=0x7f86200d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.778+0000 7f861f7fe640 1 -- 172.21.15.55:0/3465242264 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86200d3020 con 0x7f862015f450 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.779+0000 7f861f7fe640 1 --2- 172.21.15.55:0/3465242264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f86200cfe70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86200d2df0 tx=0x7f861002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b866ddcf714016d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.779+0000 7f861e7fc640 1 -- 172.21.15.55:0/3465242264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610037070 con 0x7f862015f450 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.779+0000 7f861e7fc640 1 -- 172.21.15.55:0/3465242264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8610032440 con 0x7f862015f450 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.779+0000 7f861e7fc640 1 -- 172.21.15.55:0/3465242264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610032810 con 0x7f862015f450 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 -- 172.21.15.55:0/3465242264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 msgr2=0x7f86200cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 --2- 172.21.15.55:0/3465242264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f86200cfe70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86200d2df0 tx=0x7f861002a1a0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 -- 172.21.15.55:0/3465242264 shutdown_connections 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 --2- 172.21.15.55:0/3465242264 >> v2:172.21.15.64:3300/0 conn(0x7f862015f830 0x7f86200b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 --2- 172.21.15.55:0/3465242264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f86200cfe70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 -- 172.21.15.55:0/3465242264 >> 172.21.15.55:0/3465242264 conn(0x7f862008ec90 msgr2=0x7f862009e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 -- 172.21.15.55:0/3465242264 shutdown_connections 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.780+0000 7f8625e59640 1 -- 172.21.15.55:0/3465242264 wait complete. 2024-05-10T03:53:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.781+0000 7f8625e59640 1 Processor -- start 2024-05-10T03:53:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.781+0000 7f8625e59640 1 -- start start 2024-05-10T03:53:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f8625e59640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86200d03b0 0x7f8620153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f8625e59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f862015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f8625e59640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f862015f830 0x7f862015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f8625e59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f86200d5af0 con 0x7f862015f450 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f8625e59640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f86200d5970 con 0x7f86200d03b0 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f8625e59640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f86200b5740 con 0x7f862015f830 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f862015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f862015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47604/0 (socket says 172.21.15.55:47604) 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 -- 172.21.15.55:0/3999378512 learned_addr learned my addr 172.21.15.55:0/3999378512 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 -- 172.21.15.55:0/3999378512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f862015f830 msgr2=0x7f862015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f862015f830 0x7f862015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 -- 172.21.15.55:0/3999378512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86200d03b0 msgr2=0x7f8620153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86200d03b0 0x7f8620153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.782+0000 7f861effd640 1 -- 172.21.15.55:0/3999378512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86200cb610 con 0x7f862015f450 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.783+0000 7f861effd640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f862015cac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f861400e840 tx=0x7f861400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.783+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614017070 con 0x7f862015f450 2024-05-10T03:53:34.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.783+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861400c940 con 0x7f862015f450 2024-05-10T03:53:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.783+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86200cb890 con 0x7f862015f450 2024-05-10T03:53:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.783+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861400cd10 con 0x7f862015f450 2024-05-10T03:53:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.783+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f862015c2c0 con 0x7f862015f450 2024-05-10T03:53:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.784+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f862015d060 con 0x7f862015f450 2024-05-10T03:53:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.784+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f861401a070 con 0x7f862015f450 2024-05-10T03:53:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.785+0000 7f8607fff640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f860c076240 0x7f860c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.785+0000 7f861f7fe640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f860c076240 0x7f860c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.785+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7f86140970b0 con 0x7f862015f450 2024-05-10T03:53:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.785+0000 7f861f7fe640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f860c076240 0x7f860c078700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8610034000 tx=0x7f861002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.789+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f86200cb610 con 0x7f862015f450 2024-05-10T03:53:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.982+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f862015c7a0 con 0x7f862015f450 2024-05-10T03:53:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.983+0000 7f8607fff640 1 -- 172.21.15.55:0/3999378512 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) ==== 84+0+65 (secure 0 0 0) 0x7f862015c7a0 con 0x7f862015f450 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:53:34.987 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-10T03:53:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f860c076240 msgr2=0x7f860c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f860c076240 0x7f860c078700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8610034000 tx=0x7f861002c000 comp rx=0 tx=0).stop 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 msgr2=0x7f862015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f862015cac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f861400e840 tx=0x7f861400ed00 comp rx=0 tx=0).stop 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 shutdown_connections 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f862015f830 0x7f862015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f860c076240 0x7f860c078700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862015f450 0x7f862015cac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 --2- 172.21.15.55:0/3999378512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86200d03b0 0x7f8620153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 >> 172.21.15.55:0/3999378512 conn(0x7f862008ec90 msgr2=0x7f86200d5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 shutdown_connections 2024-05-10T03:53:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:34.985+0000 7f8625e59640 1 -- 172.21.15.55:0/3999378512 wait complete. 2024-05-10T03:53:34.999 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T03:53:34.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T03:53:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.104+0000 7fe9a1423640 1 Processor -- start 2024-05-10T03:53:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.104+0000 7fe9a1423640 1 -- start start 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe9a1423640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 0x7fe99c0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe9a1423640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe99c0d2fe0 0x7fe99c0d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe9a1423640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99c0d2590 con 0x7fe99c0d3d20 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe9a1423640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fe99c0d4180 con 0x7fe99c0d2fe0 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe9a1423640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0d1190 con 0x7fe99c0d21b0 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe99c0d3d20 0x7fe99c15ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43150/0 (socket says 172.21.15.55:43150) 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99b7fe640 1 -- 172.21.15.55:0/3018007672 learned_addr learned my addr 172.21.15.55:0/3018007672 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe993fff640 1 --2- 172.21.15.55:0/3018007672 >> v2:172.21.15.64:3300/0 conn(0x7fe99c0d2fe0 0x7fe99c0d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99affd640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 0x7fe99c0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817855364 0 0) 0x7fe99c0d2590 con 0x7fe99c0d3d20 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe988003520 con 0x7fe99c0d3d20 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2010330422 0 0) 0x7fe988003520 con 0x7fe99c0d3d20 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 msgr2=0x7fe99c0cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 0x7fe99c0cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 >> v2:172.21.15.64:3300/0 conn(0x7fe99c0d2fe0 msgr2=0x7fe99c0d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 --2- 172.21.15.55:0/3018007672 >> v2:172.21.15.64:3300/0 conn(0x7fe99c0d2fe0 0x7fe99c0d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c0d0610 con 0x7fe99c0d3d20 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7fe994001a70 con 0x7fe99c0d3d20 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe993fff640 1 --2- 172.21.15.55:0/3018007672 >> v2:172.21.15.64:3300/0 conn(0x7fe99c0d2fe0 0x7fe99c0d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 >> v1:172.21.15.55:6789/0 conn(0x7fe99c0d3d20 legacy=0x7fe99c15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe988003a00 0x7fe988003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe988004800 0x7fe988004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 0x7fe9880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0d1190 con 0x7fe988003a00 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe98800b9c0 con 0x7fe988004800 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe98800bbc0 con 0x7fe99c0d21b0 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.105+0000 7fe99affd640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe988003a00 0x7fe988003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe993fff640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe988004800 0x7fe988004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99b7fe640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 0x7fe9880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99affd640 1 -- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 msgr2=0x7fe9880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99affd640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe99c0d21b0 0x7fe9880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99affd640 1 -- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe988004800 msgr2=0x7fe988004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99affd640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe988004800 0x7fe988004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99affd640 1 -- 172.21.15.55:0/3018007672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe988003520 con 0x7fe988003a00 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe993fff640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe988004800 0x7fe988004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99affd640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe988003a00 0x7fe988003e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009ac0 tx=0x7fe988005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4cf9b1121581c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.106+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c036070 con 0x7fe988003a00 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c031400 con 0x7fe988003a00 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe99a7fc640 1 -- 172.21.15.55:0/3018007672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c009690 con 0x7fe988003a00 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe9a1423640 1 -- 172.21.15.55:0/3018007672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe988003a00 msgr2=0x7fe988003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe9a1423640 1 --2- 172.21.15.55:0/3018007672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe988003a00 0x7fe988003e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009ac0 tx=0x7fe988005830 comp rx=0 tx=0).stop 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe99b7fe640 1 -- 172.21.15.55:0/3018007672 reap_dead start 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe9a1423640 1 -- 172.21.15.55:0/3018007672 shutdown_connections 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe9a1423640 1 -- 172.21.15.55:0/3018007672 >> 172.21.15.55:0/3018007672 conn(0x7fe99c09e540 msgr2=0x7fe99c0d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe9a1423640 1 -- 172.21.15.55:0/3018007672 shutdown_connections 2024-05-10T03:53:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.107+0000 7fe9a1423640 1 -- 172.21.15.55:0/3018007672 wait complete. 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.108+0000 7fe9a1423640 1 Processor -- start 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.108+0000 7fe9a1423640 1 -- start start 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe9a1423640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe988003a00 0x7fe99c0b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe9a1423640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 0x7fe99c1f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe9a1423640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe99c1f9660 0x7fe99c15f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe9a1423640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0d0bd0 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe9a1423640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0d6170 con 0x7fe99c1f9660 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe9a1423640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0d0eb0 con 0x7fe988003a00 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe993fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 0x7fe99c1f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe993fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 0x7fe99c1f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47624/0 (socket says 172.21.15.55:47624) 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe993fff640 1 -- 172.21.15.55:0/2264655366 learned_addr learned my addr 172.21.15.55:0/2264655366 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe99affd640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe988003a00 0x7fe99c0b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.109+0000 7fe99b7fe640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe99c1f9660 0x7fe99c15f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe993fff640 1 -- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe988003a00 msgr2=0x7fe99c0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe993fff640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe988003a00 0x7fe99c0b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe993fff640 1 -- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe99c1f9660 msgr2=0x7fe99c15f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe993fff640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe99c1f9660 0x7fe99c15f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe993fff640 1 -- 172.21.15.55:0/2264655366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c0cc800 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe99b7fe640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe99c1f9660 0x7fe99c15f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe993fff640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 0x7fe99c1f9120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe984011890 tx=0x7fe984011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98400fbd0 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98400fd70 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c0ccae0 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984015660 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.110+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c0cd0a0 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.111+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c06a7e0 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.112+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fe984015800 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.112+0000 7fe9937fe640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe97c076270 0x7fe97c078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.112+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7fe984097ac0 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.112+0000 7fe99affd640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe97c076270 0x7fe97c078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.113+0000 7fe99affd640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe97c076270 0x7fe97c078730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe98c033000 tx=0x7fe98c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.116+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe984019030 con 0x7fe99c0b2fa0 2024-05-10T03:53:35.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:35.310+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe99c0d35c0 con 0x7fe99c0b2fa0 2024-05-10T03:53:36.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.246+0000 7fe9937fe640 1 -- 172.21.15.55:0/2264655366 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fe9840618f0 con 0x7fe99c0b2fa0 2024-05-10T03:53:36.250 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-05-10T03:53:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe97c076270 msgr2=0x7fe97c078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe97c076270 0x7fe97c078730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe98c033000 tx=0x7fe98c008030 comp rx=0 tx=0).stop 2024-05-10T03:53:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 msgr2=0x7fe99c1f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 0x7fe99c1f9120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe984011890 tx=0x7fe984011d50 comp rx=0 tx=0).stop 2024-05-10T03:53:36.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 shutdown_connections 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe99c1f9660 0x7fe99c15f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe97c076270 0x7fe97c078730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe99c0b2fa0 0x7fe99c1f9120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 --2- 172.21.15.55:0/2264655366 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe988003a00 0x7fe99c0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 >> 172.21.15.55:0/2264655366 conn(0x7fe99c09e540 msgr2=0x7fe99c15d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 shutdown_connections 2024-05-10T03:53:36.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.248+0000 7fe9a1423640 1 -- 172.21.15.55:0/2264655366 wait complete. 2024-05-10T03:53:36.267 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T03:53:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 Processor -- start 2024-05-10T03:53:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 -- start start 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54bc15f250 0x7f54bc0d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f630 0x7f54bc0d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54bc0d3c60 con 0x7f54bc0bada0 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0d3f40 con 0x7f54bc15f250 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.374+0000 7f54c11af640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0d4220 con 0x7f54bc15f630 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54bc15f250 0x7f54bc0d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f630 0x7f54bc0d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54bc15f250 0x7f54bc0d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37176/0 (socket says 172.21.15.55:37176) 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 -- 172.21.15.55:0/2441193119 learned_addr learned my addr 172.21.15.55:0/2441193119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 -- 172.21.15.55:0/2441193119 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f630 msgr2=0x7f54bc0d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 --2- 172.21.15.55:0/2441193119 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f630 0x7f54bc0d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 -- 172.21.15.55:0/2441193119 >> v1:172.21.15.55:6789/0 conn(0x7f54bc0bada0 legacy=0x7f54bc0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:36.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.375+0000 7f54bad9d640 1 -- 172.21.15.55:0/2441193119 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0d4500 con 0x7f54bc15f250 2024-05-10T03:53:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54bad9d640 1 --2- 172.21.15.55:0/2441193119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f250 0x7f54bc0d35f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009870 tx=0x7f54a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9437ee677755cf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54ba59c640 1 -- 172.21.15.55:0/2441193119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4037070 con 0x7f54bc15f250 2024-05-10T03:53:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54ba59c640 1 -- 172.21.15.55:0/2441193119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a4032440 con 0x7f54bc15f250 2024-05-10T03:53:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54ba59c640 1 -- 172.21.15.55:0/2441193119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4032810 con 0x7f54bc15f250 2024-05-10T03:53:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 -- 172.21.15.55:0/2441193119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f250 msgr2=0x7f54bc0d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 --2- 172.21.15.55:0/2441193119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f250 0x7f54bc0d35f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009870 tx=0x7f54a402a270 comp rx=0 tx=0).stop 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 -- 172.21.15.55:0/2441193119 shutdown_connections 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 --2- 172.21.15.55:0/2441193119 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f630 0x7f54bc0d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 --2- 172.21.15.55:0/2441193119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f250 0x7f54bc0d35f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 -- 172.21.15.55:0/2441193119 >> 172.21.15.55:0/2441193119 conn(0x7f54bc0740f0 msgr2=0x7f54bc0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 -- 172.21.15.55:0/2441193119 shutdown_connections 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.376+0000 7f54c11af640 1 -- 172.21.15.55:0/2441193119 wait complete. 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 Processor -- start 2024-05-10T03:53:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 -- start start 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54bc0bada0 0x7f54bc152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f250 0x7f54bc154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 0x7f54bc0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0b7480 con 0x7f54bc15f630 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0bb230 con 0x7f54bc0bada0 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.378+0000 7f54c11af640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0b7600 con 0x7f54bc15f250 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 0x7f54bc0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54bc0bada0 0x7f54bc152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f250 0x7f54bc154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 0x7f54bc0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37188/0 (socket says 172.21.15.55:37188) 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 -- 172.21.15.55:0/3578222872 learned_addr learned my addr 172.21.15.55:0/3578222872 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 -- 172.21.15.55:0/3578222872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f250 msgr2=0x7f54bc154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f250 0x7f54bc154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 -- 172.21.15.55:0/3578222872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54bc0bada0 msgr2=0x7f54bc152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54bc0bada0 0x7f54bc152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 -- 172.21.15.55:0/3578222872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc155160 con 0x7f54bc15f630 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54bb59e640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 0x7f54bc0ce3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54b400c7d0 tx=0x7f54b400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4003b70 con 0x7f54bc15f630 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b4003d10 con 0x7f54bc15f630 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc15fa10 con 0x7f54bc15f630 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b400aa70 con 0x7f54bc15f630 2024-05-10T03:53:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.379+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc15ffd0 con 0x7f54bc15f630 2024-05-10T03:53:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.380+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc06a7e0 con 0x7f54bc15f630 2024-05-10T03:53:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.381+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f54b400ac10 con 0x7f54bc15f630 2024-05-10T03:53:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.382+0000 7f54b37fe640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f549c076240 0x7f549c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.382+0000 7f54bad9d640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f549c076240 0x7f549c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.382+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f54b4097110 con 0x7f54bc15f630 2024-05-10T03:53:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.382+0000 7f54bad9d640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f549c076240 0x7f549c078700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54a4034000 tx=0x7f54a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:36.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.386+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f54b40606d0 con 0x7f54bc15f630 2024-05-10T03:53:36.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:36.581+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f54bc0d25f0 con 0x7f54bc15f630 2024-05-10T03:53:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.256+0000 7f54b37fe640 1 -- 172.21.15.55:0/3578222872 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f54b40649d0 con 0x7f54bc15f630 2024-05-10T03:53:37.260 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-05-10T03:53:37.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f549c076240 msgr2=0x7f549c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:37.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f549c076240 0x7f549c078700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54a4034000 tx=0x7f54a402e000 comp rx=0 tx=0).stop 2024-05-10T03:53:37.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 msgr2=0x7f54bc0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:37.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 0x7f54bc0ce3d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54b400c7d0 tx=0x7f54b400cc90 comp rx=0 tx=0).stop 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 shutdown_connections 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f549c076240 0x7f549c078700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54bc15f630 0x7f54bc0ce3d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54bc15f250 0x7f54bc154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 --2- 172.21.15.55:0/3578222872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54bc0bada0 0x7f54bc152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 >> 172.21.15.55:0/3578222872 conn(0x7f54bc0740f0 msgr2=0x7f54bc15e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 shutdown_connections 2024-05-10T03:53:37.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.260+0000 7f54c11af640 1 -- 172.21.15.55:0/3578222872 wait complete. 2024-05-10T03:53:37.285 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T03:53:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.394+0000 7fd994938640 1 Processor -- start 2024-05-10T03:53:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.394+0000 7fd994938640 1 -- start start 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd994938640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd994938640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd99015f690 0x7fd9900d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd994938640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9900d4f20 0x7fd9900d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd994938640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fd9900d3e80 con 0x7fd9900d4f20 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd994938640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd9900d4160 con 0x7fd99015f690 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd994938640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd9900d4440 con 0x7fd99015f2b0 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd98ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9900d4f20 0x7fd9900d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd98ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9900d4f20 0x7fd9900d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37204/0 (socket says 172.21.15.55:37204) 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.395+0000 7fd98ed9d640 1 -- 172.21.15.55:0/327608079 learned_addr learned my addr 172.21.15.55:0/327608079 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98dd9b640 1 --2- 172.21.15.55:0/327608079 >> v2:172.21.15.64:3300/0 conn(0x7fd99015f690 0x7fd9900d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98e59c640 1 --2- 172.21.15.55:0/327608079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98ed9d640 1 -- 172.21.15.55:0/327608079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 msgr2=0x7fd9900d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98ed9d640 1 --2- 172.21.15.55:0/327608079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900d3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98ed9d640 1 -- 172.21.15.55:0/327608079 >> v2:172.21.15.64:3300/0 conn(0x7fd99015f690 msgr2=0x7fd9900d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98ed9d640 1 --2- 172.21.15.55:0/327608079 >> v2:172.21.15.64:3300/0 conn(0x7fd99015f690 0x7fd9900d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98ed9d640 1 -- 172.21.15.55:0/327608079 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9900d4720 con 0x7fd9900d4f20 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98dd9b640 1 --2- 172.21.15.55:0/327608079 >> v2:172.21.15.64:3300/0 conn(0x7fd99015f690 0x7fd9900d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.396+0000 7fd98ed9d640 1 --2- 172.21.15.55:0/327608079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9900d2270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9900d63e0 tx=0x7fd98802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46828f21b0fcd31b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd98d59a640 1 -- 172.21.15.55:0/327608079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988036070 con 0x7fd9900d4f20 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd98d59a640 1 -- 172.21.15.55:0/327608079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd988031600 con 0x7fd9900d4f20 2024-05-10T03:53:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd98d59a640 1 -- 172.21.15.55:0/327608079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9880319d0 con 0x7fd9900d4f20 2024-05-10T03:53:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 -- 172.21.15.55:0/327608079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 msgr2=0x7fd9900d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 --2- 172.21.15.55:0/327608079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9900d2270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd9900d63e0 tx=0x7fd98802a6a0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 -- 172.21.15.55:0/327608079 shutdown_connections 2024-05-10T03:53:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 --2- 172.21.15.55:0/327608079 >> v2:172.21.15.64:3300/0 conn(0x7fd99015f690 0x7fd9900d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 --2- 172.21.15.55:0/327608079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9900d2270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 --2- 172.21.15.55:0/327608079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 -- 172.21.15.55:0/327608079 >> 172.21.15.55:0/327608079 conn(0x7fd9900740f0 msgr2=0x7fd99006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 -- 172.21.15.55:0/327608079 shutdown_connections 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.397+0000 7fd994938640 1 -- 172.21.15.55:0/327608079 wait complete. 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 Processor -- start 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 -- start start 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9901f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd99015f690 0x7fd9901f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd9900d3960 con 0x7fd9900d4f20 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd9900bb230 con 0x7fd99015f690 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd994938640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd9900d3ae0 con 0x7fd99015f2b0 2024-05-10T03:53:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd98e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9901f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd98e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9901f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37206/0 (socket says 172.21.15.55:37206) 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.399+0000 7fd98e59c640 1 -- 172.21.15.55:0/662422021 learned_addr learned my addr 172.21.15.55:0/662422021 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98ed9d640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd99015f690 0x7fd9901f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98dd9b640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98e59c640 1 -- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 msgr2=0x7fd9900cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98e59c640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98e59c640 1 -- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd99015f690 msgr2=0x7fd9901f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98e59c640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd99015f690 0x7fd9901f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98e59c640 1 -- 172.21.15.55:0/662422021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9900abeb0 con 0x7fd9900d4f20 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd98e59c640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9901f4a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c7f0 tx=0x7fd98000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980015070 con 0x7fd9900d4f20 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980004220 con 0x7fd9900d4f20 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9900ac190 con 0x7fd9900d4f20 2024-05-10T03:53:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980007620 con 0x7fd9900d4f20 2024-05-10T03:53:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.400+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9900ac750 con 0x7fd9900d4f20 2024-05-10T03:53:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.401+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99006a7e0 con 0x7fd9900d4f20 2024-05-10T03:53:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.402+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fd9800077c0 con 0x7fd9900d4f20 2024-05-10T03:53:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.402+0000 7fd97effd640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd970076270 0x7fd970078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.403+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fd980097310 con 0x7fd9900d4f20 2024-05-10T03:53:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.403+0000 7fd98dd9b640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd970076270 0x7fd970078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.403+0000 7fd98dd9b640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd970076270 0x7fd970078730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd99015b400 tx=0x7fd984008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.408+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd980060d10 con 0x7fd9900d4f20 2024-05-10T03:53:37.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:37.638+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd99006c390 con 0x7fd9900d4f20 2024-05-10T03:53:38.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.269+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd980060610 con 0x7fd9900d4f20 2024-05-10T03:53:38.272 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T03:53:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.281+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd970076270 msgr2=0x7fd970078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.281+0000 7fd994938640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd970076270 0x7fd970078730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd99015b400 tx=0x7fd984008040 comp rx=0 tx=0).stop 2024-05-10T03:53:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.281+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 msgr2=0x7fd9901f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd97effd640 1 -- 172.21.15.55:0/662422021 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd98005c8a0 con 0x7fd9900d4f20 2024-05-10T03:53:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9901f4a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c7f0 tx=0x7fd98000ccb0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 shutdown_connections 2024-05-10T03:53:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd99015f690 0x7fd9901f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd99015f2b0 0x7fd9900cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd970076270 0x7fd970078730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 --2- 172.21.15.55:0/662422021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9900d4f20 0x7fd9901f4a40 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c7f0 tx=0x7fd98000ccb0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.285+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 >> 172.21.15.55:0/662422021 conn(0x7fd9900740f0 msgr2=0x7fd99015d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:38.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.287+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 shutdown_connections 2024-05-10T03:53:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.288+0000 7fd994938640 1 -- 172.21.15.55:0/662422021 wait complete. 2024-05-10T03:53:38.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:38.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.416+0000 7f05f902a640 1 Processor -- start 2024-05-10T03:53:38.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.416+0000 7f05f902a640 1 -- start start 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.416+0000 7f05f902a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 0x7f05f4074210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.416+0000 7f05f902a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f05f4073ba0 0x7f05f40b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f902a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f415d670 con 0x7f05f40b6810 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f902a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f05f40b3980 con 0x7f05f4073ba0 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f902a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f05f40cdb20 con 0x7f05f415d290 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f05f40b6810 0x7f05f40722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57878/0 (socket says 172.21.15.55:57878) 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f359e640 1 -- 172.21.15.55:0/3632782306 learned_addr learned my addr 172.21.15.55:0/3632782306 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f259c640 1 --2- 172.21.15.55:0/3632782306 >> v2:172.21.15.64:3300/0 conn(0x7f05f4073ba0 0x7f05f40b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f2d9d640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 0x7f05f4074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320579623 0 0) 0x7f05f415d670 con 0x7f05f40b6810 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05dc003520 con 0x7f05f40b6810 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3508971151 0 0) 0x7f05dc003520 con 0x7f05f40b6810 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 msgr2=0x7f05f4074210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 0x7f05f4074210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 >> v2:172.21.15.64:3300/0 conn(0x7f05f4073ba0 msgr2=0x7f05f40b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 --2- 172.21.15.55:0/3632782306 >> v2:172.21.15.64:3300/0 conn(0x7f05f4073ba0 0x7f05f40b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f40cde00 con 0x7f05f40b6810 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f05ec001a70 con 0x7f05f40b6810 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 >> v1:172.21.15.55:6789/0 conn(0x7f05f40b6810 legacy=0x7f05f40722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 0x7f05dc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05dc003fd0 0x7f05dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc004d40 0x7f05dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f05f40b3980 con 0x7f05dc003fd0 2024-05-10T03:53:38.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05f40cdb20 con 0x7f05dc004d40 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc00baa0 con 0x7f05f415d290 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f259c640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05dc003fd0 0x7f05dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f2d9d640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 0x7f05dc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.417+0000 7f05f359e640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc004d40 0x7f05dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f259c640 1 -- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 msgr2=0x7f05dc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f259c640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f415d290 0x7f05dc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f259c640 1 -- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc004d40 msgr2=0x7f05dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f259c640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc004d40 0x7f05dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f259c640 1 -- 172.21.15.55:0/3632782306 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc003520 con 0x7f05dc003fd0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f259c640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05dc003fd0 0x7f05dc004800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009ac0 tx=0x7f05dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd34923d382aad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8036070 con 0x7f05dc003fd0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8031400 con 0x7f05dc003fd0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.418+0000 7f05f1d9b640 1 -- 172.21.15.55:0/3632782306 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8009690 con 0x7f05dc003fd0 2024-05-10T03:53:38.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f902a640 1 -- 172.21.15.55:0/3632782306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05dc003fd0 msgr2=0x7f05dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f902a640 1 --2- 172.21.15.55:0/3632782306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05dc003fd0 0x7f05dc004800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009ac0 tx=0x7f05dc005830 comp rx=0 tx=0).stop 2024-05-10T03:53:38.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f359e640 1 -- 172.21.15.55:0/3632782306 reap_dead start 2024-05-10T03:53:38.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f902a640 1 -- 172.21.15.55:0/3632782306 shutdown_connections 2024-05-10T03:53:38.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f902a640 1 -- 172.21.15.55:0/3632782306 >> 172.21.15.55:0/3632782306 conn(0x7f05f40b2cc0 msgr2=0x7f05f40b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:38.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f902a640 1 -- 172.21.15.55:0/3632782306 shutdown_connections 2024-05-10T03:53:38.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.419+0000 7f05f902a640 1 -- 172.21.15.55:0/3632782306 wait complete. 2024-05-10T03:53:38.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 Processor -- start 2024-05-10T03:53:38.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 -- start start 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc003fd0 0x7f05f40af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 0x7f05f4146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f4147300 0x7f05f4154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f05f415ec90 con 0x7f05f4144700 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05f415eb10 con 0x7f05dc003fd0 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f902a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f05f415ee10 con 0x7f05f4147300 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.421+0000 7f05f259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 0x7f05f4146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 0x7f05f4146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37230/0 (socket says 172.21.15.55:37230) 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 -- 172.21.15.55:0/597720172 learned_addr learned my addr 172.21.15.55:0/597720172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f2d9d640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc003fd0 0x7f05f40af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f359e640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f4147300 0x7f05f4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 -- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f4147300 msgr2=0x7f05f4154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f4147300 0x7f05f4154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 -- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc003fd0 msgr2=0x7f05f40af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc003fd0 0x7f05f40af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 -- 172.21.15.55:0/597720172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f40af8c0 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f259c640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 0x7f05f4146dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009be0 tx=0x7f05e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8040020 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8003a40 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f40afba0 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8036040 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.422+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f40b0160 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.423+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f406f450 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.424+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05e8043020 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.424+0000 7f05db7fe640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f05e0076300 0x7f05e00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.424+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f05e80b79e0 con 0x7f05f4144700 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.424+0000 7f05f2d9d640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f05e0076300 0x7f05e00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.425+0000 7f05f2d9d640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f05e0076300 0x7f05e00787c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009900 tx=0x7f05e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:38.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.428+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05e804a030 con 0x7f05f4144700 2024-05-10T03:53:38.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.622+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05f41476e0 con 0x7f05f4144700 2024-05-10T03:53:38.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.623+0000 7f05db7fe640 1 -- 172.21.15.55:0/597720172 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16522 (secure 0 0 0) 0x7f05e80813d0 con 0x7f05f4144700 2024-05-10T03:53:38.626 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:38.626 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:37.640241+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f05e0076300 msgr2=0x7f05e00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f05e0076300 0x7f05e00787c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009900 tx=0x7f05e4008040 comp rx=0 tx=0).stop 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 msgr2=0x7f05f4146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 0x7f05f4146dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009be0 tx=0x7f05e8004730 comp rx=0 tx=0).stop 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 shutdown_connections 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05f4147300 0x7f05f4154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f05e0076300 0x7f05e00787c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05f4144700 0x7f05f4146dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 --2- 172.21.15.55:0/597720172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f05dc003fd0 0x7f05f40af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 >> 172.21.15.55:0/597720172 conn(0x7f05f40b2cc0 msgr2=0x7f05f40ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:38.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 shutdown_connections 2024-05-10T03:53:38.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.625+0000 7f05f902a640 1 -- 172.21.15.55:0/597720172 wait complete. 2024-05-10T03:53:38.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:38.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.740+0000 7f0691b0a640 1 Processor -- start 2024-05-10T03:53:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.740+0000 7f0691b0a640 1 -- start start 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.740+0000 7f0691b0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f068c162aa0 0x7f068c0d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.740+0000 7f0691b0a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c0d1d40 0x7f068c0d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f0691b0a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c0d3b90 con 0x7f068c0d3690 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f0691b0a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f068c0d5170 con 0x7f068c162aa0 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f0691b0a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f068c0d3e70 con 0x7f068c0d1d40 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f068c162aa0 0x7f068c0d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f068c162aa0 0x7f068c0d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37238/0 (socket says 172.21.15.55:37238) 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 -- 172.21.15.55:0/468889170 learned_addr learned my addr 172.21.15.55:0/468889170 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068bfff640 1 --2- 172.21.15.55:0/468889170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c0d1d40 0x7f068c0d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 -- 172.21.15.55:0/468889170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c0d1d40 msgr2=0x7f068c0d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 --2- 172.21.15.55:0/468889170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c0d1d40 0x7f068c0d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 -- 172.21.15.55:0/468889170 >> v1:172.21.15.64:6789/0 conn(0x7f068c0d3690 legacy=0x7f068c0bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.741+0000 7f068b7fe640 1 -- 172.21.15.55:0/468889170 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c0d4150 con 0x7f068c162aa0 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f068b7fe640 1 --2- 172.21.15.55:0/468889170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c162aa0 0x7f068c0d4c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f067c009870 tx=0x7f067c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8083a25a825af12 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f068affd640 1 -- 172.21.15.55:0/468889170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c037070 con 0x7f068c162aa0 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f068affd640 1 -- 172.21.15.55:0/468889170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c032440 con 0x7f068c162aa0 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f068affd640 1 -- 172.21.15.55:0/468889170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c032810 con 0x7f068c162aa0 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 -- 172.21.15.55:0/468889170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c162aa0 msgr2=0x7f068c0d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 --2- 172.21.15.55:0/468889170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c162aa0 0x7f068c0d4c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f067c009870 tx=0x7f067c02a270 comp rx=0 tx=0).stop 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 -- 172.21.15.55:0/468889170 shutdown_connections 2024-05-10T03:53:38.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 --2- 172.21.15.55:0/468889170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c0d1d40 0x7f068c0d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 --2- 172.21.15.55:0/468889170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c162aa0 0x7f068c0d4c30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 -- 172.21.15.55:0/468889170 >> 172.21.15.55:0/468889170 conn(0x7f068c0740f0 msgr2=0x7f068c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 -- 172.21.15.55:0/468889170 shutdown_connections 2024-05-10T03:53:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.742+0000 7f0691b0a640 1 -- 172.21.15.55:0/468889170 wait complete. 2024-05-10T03:53:38.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.744+0000 7f0691b0a640 1 Processor -- start 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.744+0000 7f0691b0a640 1 -- start start 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 0x7f068c0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f068c0d3690 0x7f068c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c162aa0 0x7f068c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f068c0b8460 con 0x7f068c0d1d40 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f068c0d4710 con 0x7f068c0d3690 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f068c0b85e0 con 0x7f068c162aa0 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 0x7f068c0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 0x7f068c0c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37248/0 (socket says 172.21.15.55:37248) 2024-05-10T03:53:38.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 -- 172.21.15.55:0/3624631352 learned_addr learned my addr 172.21.15.55:0/3624631352 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0682ffd640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f068c0d3690 0x7f068c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068bfff640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c162aa0 0x7f068c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 -- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c162aa0 msgr2=0x7f068c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c162aa0 0x7f068c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 -- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f068c0d3690 msgr2=0x7f068c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f068c0d3690 0x7f068c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 -- 172.21.15.55:0/3624631352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c1531f0 con 0x7f068c0d1d40 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0682ffd640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f068c0d3690 0x7f068c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068bfff640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c162aa0 0x7f068c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f068b7fe640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 0x7f068c0c7830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f067c02a2b0 tx=0x7f067c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c041020 con 0x7f068c0d1d40 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0306c0 con 0x7f068c0d1d40 2024-05-10T03:53:38.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c152150 con 0x7f068c0d1d40 2024-05-10T03:53:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.745+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c037040 con 0x7f068c0d1d40 2024-05-10T03:53:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.746+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c152710 con 0x7f068c0d1d40 2024-05-10T03:53:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.746+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c06e7a0 con 0x7f068c0d1d40 2024-05-10T03:53:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.747+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f067c044020 con 0x7f068c0d1d40 2024-05-10T03:53:38.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.748+0000 7f0688ff9640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f066c0762d0 0x7f066c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.748+0000 7f0682ffd640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f066c0762d0 0x7f066c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.748+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f067c0b7e50 con 0x7f068c0d1d40 2024-05-10T03:53:38.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.748+0000 7f0682ffd640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f066c0762d0 0x7f066c078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f068c15f860 tx=0x7f0674009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:38.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.752+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f067c04b030 con 0x7f068c0d1d40 2024-05-10T03:53:38.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.944+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f068c06d730 con 0x7f068c0d1d40 2024-05-10T03:53:38.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.945+0000 7f0688ff9640 1 -- 172.21.15.55:0/3624631352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16522 (secure 0 0 0) 0x7f067c0817a0 con 0x7f068c0d1d40 2024-05-10T03:53:38.948 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:38.948 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:37.640241+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f066c0762d0 msgr2=0x7f066c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f066c0762d0 0x7f066c078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f068c15f860 tx=0x7f0674009040 comp rx=0 tx=0).stop 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 msgr2=0x7f068c0c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 0x7f068c0c7830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f067c02a2b0 tx=0x7f067c0046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 shutdown_connections 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f068c162aa0 0x7f068c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f068c0d3690 0x7f068c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f066c0762d0 0x7f066c078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 --2- 172.21.15.55:0/3624631352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f068c0d1d40 0x7f068c0c7830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 >> 172.21.15.55:0/3624631352 conn(0x7f068c0740f0 msgr2=0x7f068c161dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 shutdown_connections 2024-05-10T03:53:38.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:38.947+0000 7f0691b0a640 1 -- 172.21.15.55:0/3624631352 wait complete. 2024-05-10T03:53:38.961 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T03:53:39.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.065+0000 7f75f2e25640 1 Processor -- start 2024-05-10T03:53:39.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.065+0000 7f75f2e25640 1 -- start start 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f2e25640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec15f690 0x7f75ec0d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f2e25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75ec0d4f20 0x7f75ec0d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f2e25640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec0d3e80 con 0x7f75ec15f2b0 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f2e25640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec0b9490 con 0x7f75ec0d4f20 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f2e25640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0d4160 con 0x7f75ec15f690 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f13c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75ec0d4f20 0x7f75ec0d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f13c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75ec0d4f20 0x7f75ec0d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37262/0 (socket says 172.21.15.55:37262) 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.066+0000 7f75f13c2640 1 -- 172.21.15.55:0/109594870 learned_addr learned my addr 172.21.15.55:0/109594870 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.067+0000 7f75ebfff640 1 --2- 172.21.15.55:0/109594870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec15f690 0x7f75ec0d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:39.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.067+0000 7f75f13c2640 1 -- 172.21.15.55:0/109594870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec15f690 msgr2=0x7f75ec0d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.067+0000 7f75f13c2640 1 --2- 172.21.15.55:0/109594870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec15f690 0x7f75ec0d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.067+0000 7f75f13c2640 1 -- 172.21.15.55:0/109594870 >> v1:172.21.15.64:6789/0 conn(0x7f75ec15f2b0 legacy=0x7f75ec0d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.067+0000 7f75f13c2640 1 -- 172.21.15.55:0/109594870 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0d4440 con 0x7f75ec0d4f20 2024-05-10T03:53:39.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f13c2640 1 --2- 172.21.15.55:0/109594870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec0d4f20 0x7f75ec0d2270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009870 tx=0x7f75d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e918054aac2580 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75eb7fe640 1 -- 172.21.15.55:0/109594870 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4037070 con 0x7f75ec0d4f20 2024-05-10T03:53:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75eb7fe640 1 -- 172.21.15.55:0/109594870 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4032440 con 0x7f75ec0d4f20 2024-05-10T03:53:39.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75eb7fe640 1 -- 172.21.15.55:0/109594870 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4032810 con 0x7f75ec0d4f20 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 -- 172.21.15.55:0/109594870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec0d4f20 msgr2=0x7f75ec0d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 --2- 172.21.15.55:0/109594870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec0d4f20 0x7f75ec0d2270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009870 tx=0x7f75d402a270 comp rx=0 tx=0).stop 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 -- 172.21.15.55:0/109594870 shutdown_connections 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 --2- 172.21.15.55:0/109594870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec0d4f20 0x7f75ec0d2270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 --2- 172.21.15.55:0/109594870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec15f690 0x7f75ec0d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 -- 172.21.15.55:0/109594870 >> 172.21.15.55:0/109594870 conn(0x7f75ec0740f0 msgr2=0x7f75ec06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 -- 172.21.15.55:0/109594870 shutdown_connections 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.068+0000 7f75f2e25640 1 -- 172.21.15.55:0/109594870 wait complete. 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.069+0000 7f75f2e25640 1 Processor -- start 2024-05-10T03:53:39.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 -- start start 2024-05-10T03:53:39.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec0d4f20 0x7f75ec161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:39.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75ec15f2b0 0x7f75ec15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:39.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 0x7f75ec157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0d3b30 con 0x7f75ec15f690 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0d4a40 con 0x7f75ec15f2b0 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.070+0000 7f75f2e25640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0bb230 con 0x7f75ec0d4f20 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 0x7f75ec157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 0x7f75ec157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37270/0 (socket says 172.21.15.55:37270) 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 -- 172.21.15.55:0/1028211467 learned_addr learned my addr 172.21.15.55:0/1028211467 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75ebfff640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75ec15f2b0 0x7f75ec15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f0bc1640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec0d4f20 0x7f75ec161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 -- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec0d4f20 msgr2=0x7f75ec161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec0d4f20 0x7f75ec161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 -- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75ec15f2b0 msgr2=0x7f75ec15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:39.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75ec15f2b0 0x7f75ec15c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 -- 172.21.15.55:0/1028211467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec152930 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f0bc1640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec0d4f20 0x7f75ec161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f13c2640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 0x7f75ec157c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75d402a2b0 tx=0x7f75d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4041020 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d403d640 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec15cb70 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d4037040 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.071+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec15d130 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.072+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ec06a7e0 con 0x7f75ec15f690 2024-05-10T03:53:39.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.073+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75d4044020 con 0x7f75ec15f690 2024-05-10T03:53:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.073+0000 7f75e97fa640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75cc076300 0x7f75cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:39.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.073+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f75d40b7ca0 con 0x7f75ec15f690 2024-05-10T03:53:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.073+0000 7f75f0bc1640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75cc076300 0x7f75cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:39.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.074+0000 7f75f0bc1640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75cc076300 0x7f75cc0787c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75e4007fd0 tx=0x7f75e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:39.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.078+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75d404b030 con 0x7f75ec15f690 2024-05-10T03:53:39.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:39.316+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f75ec0b7d20 con 0x7f75ec15f690 2024-05-10T03:53:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.282+0000 7f75e97fa640 1 -- 172.21.15.55:0/1028211467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f75d4081570 con 0x7f75ec15f690 2024-05-10T03:53:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.286+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75cc076300 msgr2=0x7f75cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.286+0000 7f75f2e25640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75cc076300 0x7f75cc0787c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75e4007fd0 tx=0x7f75e4009040 comp rx=0 tx=0).stop 2024-05-10T03:53:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.286+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 msgr2=0x7f75ec157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.286+0000 7f75f2e25640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 0x7f75ec157c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f75d402a2b0 tx=0x7f75d40046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 shutdown_connections 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75cc076300 0x7f75cc0787c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75ec15f690 0x7f75ec157c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75ec15f2b0 0x7f75ec15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 --2- 172.21.15.55:0/1028211467 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75ec0d4f20 0x7f75ec161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 >> 172.21.15.55:0/1028211467 conn(0x7f75ec0740f0 msgr2=0x7f75ec15d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 shutdown_connections 2024-05-10T03:53:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.287+0000 7f75f2e25640 1 -- 172.21.15.55:0/1028211467 wait complete. 2024-05-10T03:53:40.303 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T03:53:40.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T03:53:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.413+0000 7f47d8733640 1 Processor -- start 2024-05-10T03:53:40.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.413+0000 7f47d8733640 1 -- start start 2024-05-10T03:53:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d8733640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47d00b63e0 0x7f47d0071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d8733640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d0072210 0x7f47d015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d8733640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d0146fa0 con 0x7f47d0146bc0 2024-05-10T03:53:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d8733640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f47d0072640 con 0x7f47d00b63e0 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d8733640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f47d00b6980 con 0x7f47d0072210 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47d00b63e0 0x7f47d0071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47d00b63e0 0x7f47d0071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37282/0 (socket says 172.21.15.55:37282) 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 -- 172.21.15.55:0/4163446503 learned_addr learned my addr 172.21.15.55:0/4163446503 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d64cf640 1 --1- 172.21.15.55:0/4163446503 >> v1:172.21.15.55:6789/0 conn(0x7f47d0146bc0 0x7f47d00d2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57882/0 (socket says 172.21.15.55:57882) 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d6cd0640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d0072210 0x7f47d015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 -- 172.21.15.55:0/4163446503 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d0072210 msgr2=0x7f47d015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d0072210 0x7f47d015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 -- 172.21.15.55:0/4163446503 >> v1:172.21.15.55:6789/0 conn(0x7f47d0146bc0 legacy=0x7f47d00d2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d5cce640 1 -- 172.21.15.55:0/4163446503 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d00b6c60 con 0x7f47d00b63e0 2024-05-10T03:53:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.414+0000 7f47d6cd0640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d0072210 0x7f47d015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.415+0000 7f47d5cce640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d00b63e0 0x7f47d0071cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009870 tx=0x7f47c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f38cd31d76db132 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.415+0000 7f47d54cd640 1 -- 172.21.15.55:0/4163446503 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0037070 con 0x7f47d00b63e0 2024-05-10T03:53:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.415+0000 7f47d54cd640 1 -- 172.21.15.55:0/4163446503 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c0032440 con 0x7f47d00b63e0 2024-05-10T03:53:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.415+0000 7f47d54cd640 1 -- 172.21.15.55:0/4163446503 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0032810 con 0x7f47d00b63e0 2024-05-10T03:53:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 -- 172.21.15.55:0/4163446503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d00b63e0 msgr2=0x7f47d0071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d00b63e0 0x7f47d0071cd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009870 tx=0x7f47c002a270 comp rx=0 tx=0).stop 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 -- 172.21.15.55:0/4163446503 shutdown_connections 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d0072210 0x7f47d015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 --2- 172.21.15.55:0/4163446503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d00b63e0 0x7f47d0071cd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 -- 172.21.15.55:0/4163446503 >> 172.21.15.55:0/4163446503 conn(0x7f47d0070730 msgr2=0x7f47d0070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 -- 172.21.15.55:0/4163446503 shutdown_connections 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.416+0000 7f47d8733640 1 -- 172.21.15.55:0/4163446503 wait complete. 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.417+0000 7f47d8733640 1 Processor -- start 2024-05-10T03:53:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.417+0000 7f47d8733640 1 -- start start 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d8733640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 0x7f47d00b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d8733640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d00b63e0 0x7f47d00b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d8733640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0146bc0 0x7f47d01f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d8733640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00b7500 con 0x7f47d0072210 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d8733640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00b7220 con 0x7f47d0146bc0 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d8733640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f47d00b7a20 con 0x7f47d00b63e0 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 0x7f47d00b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 0x7f47d00b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37298/0 (socket says 172.21.15.55:37298) 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 -- 172.21.15.55:0/2831839627 learned_addr learned my addr 172.21.15.55:0/2831839627 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d5cce640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d00b63e0 0x7f47d00b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 -- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d00b63e0 msgr2=0x7f47d00b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d00b63e0 0x7f47d00b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 -- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0146bc0 msgr2=0x7f47d01f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0146bc0 0x7f47d01f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.418+0000 7f47d64cf640 1 -- 172.21.15.55:0/2831839627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d0140390 con 0x7f47d0072210 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.419+0000 7f47d64cf640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 0x7f47d00b5430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47cc001eb0 tx=0x7f47cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.419+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0074e0 con 0x7f47d0072210 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.419+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47cc007680 con 0x7f47d0072210 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.419+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d01f3ee0 con 0x7f47d0072210 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.419+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc0049e0 con 0x7f47d0072210 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.419+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d01f6c90 con 0x7f47d0072210 2024-05-10T03:53:40.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.420+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d006a7e0 con 0x7f47d0072210 2024-05-10T03:53:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.420+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47cc01a020 con 0x7f47d0072210 2024-05-10T03:53:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.421+0000 7f47c6ffd640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f47b4076300 0x7f47b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.421+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47cc096d00 con 0x7f47d0072210 2024-05-10T03:53:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.421+0000 7f47d5cce640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f47b4076300 0x7f47b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.421+0000 7f47d5cce640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f47b4076300 0x7f47b40787c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f47c0034000 tx=0x7f47c002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:40.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.425+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47d0140390 con 0x7f47d0072210 2024-05-10T03:53:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:40.654+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f47d00b7cf0 con 0x7f47d0072210 2024-05-10T03:53:41.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.292+0000 7f47c6ffd640 1 -- 172.21.15.55:0/2831839627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f47cc0606f0 con 0x7f47d0072210 2024-05-10T03:53:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f47b4076300 msgr2=0x7f47b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f47b4076300 0x7f47b40787c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f47c0034000 tx=0x7f47c002e000 comp rx=0 tx=0).stop 2024-05-10T03:53:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 msgr2=0x7f47d00b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 0x7f47d00b5430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47cc001eb0 tx=0x7f47cc00c890 comp rx=0 tx=0).stop 2024-05-10T03:53:41.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 shutdown_connections 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47d0146bc0 0x7f47d01f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47d00b63e0 0x7f47d00b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f47b4076300 0x7f47b40787c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 --2- 172.21.15.55:0/2831839627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47d0072210 0x7f47d00b5430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 >> 172.21.15.55:0/2831839627 conn(0x7f47d0070730 msgr2=0x7f47d00b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 shutdown_connections 2024-05-10T03:53:41.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.295+0000 7f47d8733640 1 -- 172.21.15.55:0/2831839627 wait complete. 2024-05-10T03:53:41.311 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T03:53:41.311 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:53:41.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.418+0000 7f93bffd0640 1 Processor -- start 2024-05-10T03:53:41.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.419+0000 7f93bffd0640 1 -- start start 2024-05-10T03:53:41.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.419+0000 7f93bffd0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93b80d5c20 0x7f93b8160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.419+0000 7f93bffd0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b80d6250 con 0x7f93b80d1cc0 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.419+0000 7f93bffd0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b80d0080 con 0x7f93b815f700 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.419+0000 7f93bffd0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f93b815fae0 con 0x7f93b80d5c20 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.419+0000 7f93bd56b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93b80d5c20 0x7f93b8160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.420+0000 7f93bd56b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93b80d5c20 0x7f93b8160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37306/0 (socket says 172.21.15.55:37306) 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.420+0000 7f93bd56b640 1 -- 172.21.15.55:0/2170828489 learned_addr learned my addr 172.21.15.55:0/2170828489 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.420+0000 7f93bd56b640 1 -- 172.21.15.55:0/2170828489 >> v1:172.21.15.64:6789/0 conn(0x7f93b815f700 legacy=0x7f93b80d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.420+0000 7f93bd56b640 1 -- 172.21.15.55:0/2170828489 >> v1:172.21.15.55:6789/0 conn(0x7f93b80d1cc0 legacy=0x7f93b80d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.420+0000 7f93bcd6a640 1 -- 172.21.15.55:0/2170828489 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931150190 0 0) 0x7f93b80d0080 con 0x7f93b815f700 2024-05-10T03:53:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.420+0000 7f93bd56b640 1 -- 172.21.15.55:0/2170828489 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b80d0360 con 0x7f93b80d5c20 2024-05-10T03:53:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bd56b640 1 --2- 172.21.15.55:0/2170828489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d5c20 0x7f93b8160670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009870 tx=0x7f93ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e05a3fa308c0d5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bcd6a640 1 -- 172.21.15.55:0/2170828489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac037070 con 0x7f93b80d5c20 2024-05-10T03:53:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bcd6a640 1 -- 172.21.15.55:0/2170828489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac02ae50 con 0x7f93b80d5c20 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bcd6a640 1 -- 172.21.15.55:0/2170828489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac032860 con 0x7f93b80d5c20 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 -- 172.21.15.55:0/2170828489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d5c20 msgr2=0x7f93b8160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 --2- 172.21.15.55:0/2170828489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d5c20 0x7f93b8160670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009870 tx=0x7f93ac02a300 comp rx=0 tx=0).stop 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 -- 172.21.15.55:0/2170828489 shutdown_connections 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 --2- 172.21.15.55:0/2170828489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d5c20 0x7f93b8160670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 -- 172.21.15.55:0/2170828489 >> 172.21.15.55:0/2170828489 conn(0x7f93b809e5d0 msgr2=0x7f93b80d52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 -- 172.21.15.55:0/2170828489 shutdown_connections 2024-05-10T03:53:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.421+0000 7f93bffd0640 1 -- 172.21.15.55:0/2170828489 wait complete. 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 Processor -- start 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 -- start start 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 0x7f93b80b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b80d5c20 0x7f93b80ba670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b815f700 0x7f93b80babb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80d0920 con 0x7f93b80d1cc0 2024-05-10T03:53:41.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f93b8160bb0 con 0x7f93b815f700 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bffd0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f93b80d35d0 con 0x7f93b80d5c20 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.423+0000 7f93bdd6c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 0x7f93b80b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 0x7f93b80b8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37316/0 (socket says 172.21.15.55:37316) 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 -- 172.21.15.55:0/3279040708 learned_addr learned my addr 172.21.15.55:0/3279040708 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93be56d640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b815f700 0x7f93b80babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bd56b640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b80d5c20 0x7f93b80ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 -- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b80d5c20 msgr2=0x7f93b80ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b80d5c20 0x7f93b80ba670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 -- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b815f700 msgr2=0x7f93b80babb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b815f700 0x7f93b80babb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 -- 172.21.15.55:0/3279040708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b814fc90 con 0x7f93b80d1cc0 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bd56b640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b80d5c20 0x7f93b80ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93be56d640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b815f700 0x7f93b80babb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bdd6c640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 0x7f93b80b8170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c3f0 tx=0x7f93b000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:41.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0017070 con 0x7f93b80d1cc0 2024-05-10T03:53:41.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b00035f0 con 0x7f93b80d1cc0 2024-05-10T03:53:41.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b00039e0 con 0x7f93b80d1cc0 2024-05-10T03:53:41.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b80b51f0 con 0x7f93b80d1cc0 2024-05-10T03:53:41.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.424+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b80b57b0 con 0x7f93b80d1cc0 2024-05-10T03:53:41.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.425+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b80a3240 con 0x7f93b80d1cc0 2024-05-10T03:53:41.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.426+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93b001a070 con 0x7f93b80d1cc0 2024-05-10T03:53:41.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.426+0000 7f93b67fc640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93a40762d0 0x7f93a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.427+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f93b0096950 con 0x7f93b80d1cc0 2024-05-10T03:53:41.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.427+0000 7f93bd56b640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93a40762d0 0x7f93a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.427+0000 7f93bd56b640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93a40762d0 0x7f93a4078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93ac034000 tx=0x7f93ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:41.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.431+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93b0060340 con 0x7f93b80d1cc0 2024-05-10T03:53:41.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:53:41.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:53:41.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.665+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93b815ef20 con 0x7f93b80d1cc0 2024-05-10T03:53:41.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.666+0000 7f93b67fc640 1 -- 172.21.15.55:0/3279040708 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f93b005fc40 con 0x7f93b80d1cc0 2024-05-10T03:53:41.669 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:41.669 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:53:41.669 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93a40762d0 msgr2=0x7f93a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93a40762d0 0x7f93a4078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93ac034000 tx=0x7f93ac02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 msgr2=0x7f93b80b8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 0x7f93b80b8170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c3f0 tx=0x7f93b000c8b0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 shutdown_connections 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b815f700 0x7f93b80babb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b80d5c20 0x7f93b80ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93a40762d0 0x7f93a4078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 --2- 172.21.15.55:0/3279040708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93b80d1cc0 0x7f93b80b8170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 >> 172.21.15.55:0/3279040708 conn(0x7f93b809e5d0 msgr2=0x7f93b80ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 shutdown_connections 2024-05-10T03:53:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.668+0000 7f93bffd0640 1 -- 172.21.15.55:0/3279040708 wait complete. 2024-05-10T03:53:41.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.782+0000 7ff5cd751640 1 Processor -- start 2024-05-10T03:53:41.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.783+0000 7ff5cd751640 1 -- start start 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.783+0000 7ff5cd751640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff5c80d0e20 0x7ff5c8071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.783+0000 7ff5cd751640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5c80d1200 0x7ff5c815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.783+0000 7ff5cd751640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c80709c0 con 0x7ff5c80d2520 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.783+0000 7ff5cd751640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c8070ca0 con 0x7ff5c80d1200 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.783+0000 7ff5cd751640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c8070f80 con 0x7ff5c80d0e20 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5c80d1200 0x7ff5c815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5c80d1200 0x7ff5c815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37324/0 (socket says 172.21.15.55:37324) 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 -- 172.21.15.55:0/3453929325 learned_addr learned my addr 172.21.15.55:0/3453929325 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c6ffd640 1 --2- 172.21.15.55:0/3453929325 >> v2:172.21.15.64:3300/0 conn(0x7ff5c80d0e20 0x7ff5c8071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 -- 172.21.15.55:0/3453929325 >> v2:172.21.15.64:3300/0 conn(0x7ff5c80d0e20 msgr2=0x7ff5c8071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 --2- 172.21.15.55:0/3453929325 >> v2:172.21.15.64:3300/0 conn(0x7ff5c80d0e20 0x7ff5c8071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 -- 172.21.15.55:0/3453929325 >> v1:172.21.15.64:6789/0 conn(0x7ff5c80d2520 legacy=0x7ff5c815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:41.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.784+0000 7ff5c67fc640 1 -- 172.21.15.55:0/3453929325 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c8071260 con 0x7ff5c80d1200 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5c67fc640 1 --2- 172.21.15.55:0/3453929325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d1200 0x7ff5c815d020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80d0150 tx=0x7ff5bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3d83c4303717e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5c5ffb640 1 -- 172.21.15.55:0/3453929325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc037070 con 0x7ff5c80d1200 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5c5ffb640 1 -- 172.21.15.55:0/3453929325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc032440 con 0x7ff5c80d1200 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5c5ffb640 1 -- 172.21.15.55:0/3453929325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc032810 con 0x7ff5c80d1200 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 -- 172.21.15.55:0/3453929325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d1200 msgr2=0x7ff5c815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 --2- 172.21.15.55:0/3453929325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d1200 0x7ff5c815d020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80d0150 tx=0x7ff5bc02a140 comp rx=0 tx=0).stop 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 -- 172.21.15.55:0/3453929325 shutdown_connections 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 --2- 172.21.15.55:0/3453929325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d1200 0x7ff5c815d020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 --2- 172.21.15.55:0/3453929325 >> v2:172.21.15.64:3300/0 conn(0x7ff5c80d0e20 0x7ff5c8071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 -- 172.21.15.55:0/3453929325 >> 172.21.15.55:0/3453929325 conn(0x7ff5c806f940 msgr2=0x7ff5c806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 -- 172.21.15.55:0/3453929325 shutdown_connections 2024-05-10T03:53:41.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.785+0000 7ff5cd751640 1 -- 172.21.15.55:0/3453929325 wait complete. 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 Processor -- start 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 -- start start 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 0x7ff5c8147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5c80d1200 0x7ff5c8148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5c80d2520 0x7ff5c81f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c80d1800 con 0x7ff5c80d0e20 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c80d1680 con 0x7ff5c80d1200 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.787+0000 7ff5cd751640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c80d29b0 con 0x7ff5c80d2520 2024-05-10T03:53:41.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 0x7ff5c8147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 0x7ff5c8147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37328/0 (socket says 172.21.15.55:37328) 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 -- 172.21.15.55:0/2933062112 learned_addr learned my addr 172.21.15.55:0/2933062112 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c67fc640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5c80d1200 0x7ff5c8148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c77fe640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5c80d2520 0x7ff5c81f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 -- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5c80d2520 msgr2=0x7ff5c81f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5c80d2520 0x7ff5c81f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 -- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5c80d1200 msgr2=0x7ff5c8148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5c80d1200 0x7ff5c8148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 -- 172.21.15.55:0/2933062112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c80b5420 con 0x7ff5c80d0e20 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c77fe640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5c80d2520 0x7ff5c81f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5c6ffd640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 0x7ff5c8147bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800c7f0 tx=0x7ff5b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8015070 con 0x7ff5c80d0e20 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b8004240 con 0x7ff5c80d0e20 2024-05-10T03:53:41.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c80b5700 con 0x7ff5c80d0e20 2024-05-10T03:53:41.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8007620 con 0x7ff5c80d0e20 2024-05-10T03:53:41.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.788+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c80b4df0 con 0x7ff5c80d0e20 2024-05-10T03:53:41.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.789+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c80705a0 con 0x7ff5c80d0e20 2024-05-10T03:53:41.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.790+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff5b80079d0 con 0x7ff5c80d0e20 2024-05-10T03:53:41.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.790+0000 7ff5af7fe640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff5b40762d0 0x7ff5b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:41.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.791+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5b8097a80 con 0x7ff5c80d0e20 2024-05-10T03:53:41.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.791+0000 7ff5c67fc640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff5b40762d0 0x7ff5b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:41.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.791+0000 7ff5c67fc640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff5b40762d0 0x7ff5b4078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc034000 tx=0x7ff5bc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:41.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.795+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5b80613e0 con 0x7ff5c80d0e20 2024-05-10T03:53:41.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.992+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5c8050820 con 0x7ff5c80d0e20 2024-05-10T03:53:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.993+0000 7ff5af7fe640 1 -- 172.21.15.55:0/2933062112 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7ff5b80693d0 con 0x7ff5c80d0e20 2024-05-10T03:53:41.996 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:41.996 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff5b40762d0 msgr2=0x7ff5b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff5b40762d0 0x7ff5b4078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc034000 tx=0x7ff5bc02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 msgr2=0x7ff5c8147bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 0x7ff5c8147bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800c7f0 tx=0x7ff5b800ccb0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 shutdown_connections 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5c80d2520 0x7ff5c81f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5c80d1200 0x7ff5c8148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff5b40762d0 0x7ff5b4078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 --2- 172.21.15.55:0/2933062112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5c80d0e20 0x7ff5c8147bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 >> 172.21.15.55:0/2933062112 conn(0x7ff5c806f940 msgr2=0x7ff5c80cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 shutdown_connections 2024-05-10T03:53:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:41.995+0000 7ff5cd751640 1 -- 172.21.15.55:0/2933062112 wait complete. 2024-05-10T03:53:42.009 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T03:53:42.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:42.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.110+0000 7f4501df7640 1 Processor -- start 2024-05-10T03:53:42.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.110+0000 7f4501df7640 1 -- start start 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f4501df7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc162aa0 0x7f44fc0d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f4501df7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc0bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f4501df7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc0d3b90 con 0x7f44fc0d1d40 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f4501df7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f44fc0d5170 con 0x7f44fc162aa0 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f4501df7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f44fc0d3e70 con 0x7f44fc0d3690 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc162aa0 0x7f44fc0d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc162aa0 0x7f44fc0d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37330/0 (socket says 172.21.15.55:37330) 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44fc0d1d40 0x7f44fc0b8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57892/0 (socket says 172.21.15.55:57892) 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 -- 172.21.15.55:0/390129436 learned_addr learned my addr 172.21.15.55:0/390129436 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44faffd640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc0bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 -- 172.21.15.55:0/390129436 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 msgr2=0x7f44fc0bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc0bac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 -- 172.21.15.55:0/390129436 >> v1:172.21.15.55:6789/0 conn(0x7f44fc0d1d40 legacy=0x7f44fc0b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.111+0000 7f44fb7fe640 1 -- 172.21.15.55:0/390129436 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc0d4150 con 0x7f44fc162aa0 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.112+0000 7f44faffd640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc0bac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.112+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc162aa0 0x7f44fc0d4c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009870 tx=0x7f44ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b9944294869f79 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.112+0000 7f44fa7fc640 1 -- 172.21.15.55:0/390129436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec037070 con 0x7f44fc162aa0 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.112+0000 7f44fa7fc640 1 -- 172.21.15.55:0/390129436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec032440 con 0x7f44fc162aa0 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.112+0000 7f44fa7fc640 1 -- 172.21.15.55:0/390129436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec032810 con 0x7f44fc162aa0 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 -- 172.21.15.55:0/390129436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc162aa0 msgr2=0x7f44fc0d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc162aa0 0x7f44fc0d4c30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009870 tx=0x7f44ec02a270 comp rx=0 tx=0).stop 2024-05-10T03:53:42.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 -- 172.21.15.55:0/390129436 shutdown_connections 2024-05-10T03:53:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc0bac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 --2- 172.21.15.55:0/390129436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc162aa0 0x7f44fc0d4c30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 -- 172.21.15.55:0/390129436 >> 172.21.15.55:0/390129436 conn(0x7f44fc0740f0 msgr2=0x7f44fc06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 -- 172.21.15.55:0/390129436 shutdown_connections 2024-05-10T03:53:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.113+0000 7f4501df7640 1 -- 172.21.15.55:0/390129436 wait complete. 2024-05-10T03:53:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.114+0000 7f4501df7640 1 Processor -- start 2024-05-10T03:53:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.114+0000 7f4501df7640 1 -- start start 2024-05-10T03:53:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f4501df7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 0x7f44fc14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f4501df7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f4501df7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44fc162aa0 0x7f44fc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f4501df7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0bb190 con 0x7f44fc0d1d40 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f4501df7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc0d4710 con 0x7f44fc162aa0 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f4501df7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f44fc0d21a0 con 0x7f44fc0d3690 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 0x7f44fc14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 0x7f44fc14e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37336/0 (socket says 172.21.15.55:37336) 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 -- 172.21.15.55:0/780991288 learned_addr learned my addr 172.21.15.55:0/780991288 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fbfff640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44fc162aa0 0x7f44fc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44faffd640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 -- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 msgr2=0x7f44fc154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 -- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44fc162aa0 msgr2=0x7f44fc155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44fc162aa0 0x7f44fc155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.115+0000 7f44fb7fe640 1 -- 172.21.15.55:0/780991288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc0ceaf0 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.116+0000 7f44fb7fe640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 0x7f44fc14e940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44ec02a2b0 tx=0x7f44ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.116+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec037040 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.116+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec042070 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.116+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc0c9240 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.116+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec030bd0 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.116+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc0c9800 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.117+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44fc06e7a0 con 0x7f44fc0d1d40 2024-05-10T03:53:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.118+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f44ec047460 con 0x7f44fc0d1d40 2024-05-10T03:53:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.118+0000 7f44e3fff640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f44e80762d0 0x7f44e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.118+0000 7f44faffd640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f44e80762d0 0x7f44e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.118+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f44ec0b8190 con 0x7f44fc0d1d40 2024-05-10T03:53:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.119+0000 7f44faffd640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f44e80762d0 0x7f44e8078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44fc1f8600 tx=0x7f44f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.123+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f44ec081b80 con 0x7f44fc0d1d40 2024-05-10T03:53:42.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.313+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44fc1573c0 con 0x7f44e80762d0 2024-05-10T03:53:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.319+0000 7f44e3fff640 1 -- 172.21.15.55:0/780991288 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246617 (secure 0 0 0) 0x7f44fc1573c0 con 0x7f44e80762d0 2024-05-10T03:53:42.324 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:42.326 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f44e80762d0 msgr2=0x7f44e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f44e80762d0 0x7f44e8078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44fc1f8600 tx=0x7f44f0008040 comp rx=0 tx=0).stop 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 msgr2=0x7f44fc14e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 0x7f44fc14e940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44ec02a2b0 tx=0x7f44ec0046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 shutdown_connections 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44fc162aa0 0x7f44fc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f44fc0d3690 0x7f44fc154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f44e80762d0 0x7f44e8078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 --2- 172.21.15.55:0/780991288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0d1d40 0x7f44fc14e940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 >> 172.21.15.55:0/780991288 conn(0x7f44fc0740f0 msgr2=0x7f44fc0b9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 shutdown_connections 2024-05-10T03:53:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.322+0000 7f4501df7640 1 -- 172.21.15.55:0/780991288 wait complete. 2024-05-10T03:53:42.336 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-10T03:53:41.782320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":2532,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":2592768,"data_stored":1621695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.522094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278267+0000","last_change":"2024-05-10T03:53:37.278267+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278267+0000","last_undegraded":"2024-05-10T03:53:37.278267+0000","last_fullsized":"2024-05-10T03:53:37.278267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270114+0000","last_change":"2024-05-10T03:53:37.270114+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270114+0000","last_undegraded":"2024-05-10T03:53:37.270114+0000","last_fullsized":"2024-05-10T03:53:37.270114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270139+0000","last_change":"2024-05-10T03:53:37.270139+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270139+0000","last_undegraded":"2024-05-10T03:53:37.270139+0000","last_fullsized":"2024-05-10T03:53:37.270139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268106+0000","last_change":"2024-05-10T03:53:37.268106+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268106+0000","last_undegraded":"2024-05-10T03:53:37.268106+0000","last_fullsized":"2024-05-10T03:53:37.268106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272282+0000","last_change":"2024-05-10T03:53:37.272282+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272282+0000","last_undegraded":"2024-05-10T03:53:37.272282+0000","last_fullsized":"2024-05-10T03:53:37.272282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267681+0000","last_change":"2024-05-10T03:53:37.267681+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267681+0000","last_undegraded":"2024-05-10T03:53:37.267681+0000","last_fullsized":"2024-05-10T03:53:37.267681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.276203+0000","last_change":"2024-05-10T03:53:37.276203+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.276203+0000","last_undegraded":"2024-05-10T03:53:37.276203+0000","last_fullsized":"2024-05-10T03:53:37.276203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278903+0000","last_change":"2024-05-10T03:53:37.278903+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278903+0000","last_undegraded":"2024-05-10T03:53:37.278903+0000","last_fullsized":"2024-05-10T03:53:37.278903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.277629+0000","last_change":"2024-05-10T03:53:37.277629+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.277629+0000","last_undegraded":"2024-05-10T03:53:37.277629+0000","last_fullsized":"2024-05-10T03:53:37.277629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270685+0000","last_change":"2024-05-10T03:53:37.270685+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270685+0000","last_undegraded":"2024-05-10T03:53:37.270685+0000","last_fullsized":"2024-05-10T03:53:37.270685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268945+0000","last_change":"2024-05-10T03:53:37.268945+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268945+0000","last_undegraded":"2024-05-10T03:53:37.268945+0000","last_fullsized":"2024-05-10T03:53:37.268945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264968+0000","last_change":"2024-05-10T03:53:37.264968+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264968+0000","last_undegraded":"2024-05-10T03:53:37.264968+0000","last_fullsized":"2024-05-10T03:53:37.264968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273466+0000","last_change":"2024-05-10T03:53:37.273466+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273466+0000","last_undegraded":"2024-05-10T03:53:37.273466+0000","last_fullsized":"2024-05-10T03:53:37.273466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270376+0000","last_change":"2024-05-10T03:53:37.270376+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270376+0000","last_undegraded":"2024-05-10T03:53:37.270376+0000","last_fullsized":"2024-05-10T03:53:37.270376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270497+0000","last_change":"2024-05-10T03:53:37.270497+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270497+0000","last_undegraded":"2024-05-10T03:53:37.270497+0000","last_fullsized":"2024-05-10T03:53:37.270497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267716+0000","last_change":"2024-05-10T03:53:37.267716+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267716+0000","last_undegraded":"2024-05-10T03:53:37.267716+0000","last_fullsized":"2024-05-10T03:53:37.267716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267083+0000","last_change":"2024-05-10T03:53:37.267083+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267083+0000","last_undegraded":"2024-05-10T03:53:37.267083+0000","last_fullsized":"2024-05-10T03:53:37.267083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269412+0000","last_change":"2024-05-10T03:53:37.269412+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269412+0000","last_undegraded":"2024-05-10T03:53:37.269412+0000","last_fullsized":"2024-05-10T03:53:37.269412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271231+0000","last_change":"2024-05-10T03:53:37.271231+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271231+0000","last_undegraded":"2024-05-10T03:53:37.271231+0000","last_fullsized":"2024-05-10T03:53:37.271231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268672+0000","last_change":"2024-05-10T03:53:37.268672+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268672+0000","last_undegraded":"2024-05-10T03:53:37.268672+0000","last_fullsized":"2024-05-10T03:53:37.268672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273357+0000","last_change":"2024-05-10T03:53:37.273357+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273357+0000","last_undegraded":"2024-05-10T03:53:37.273357+0000","last_fullsized":"2024-05-10T03:53:37.273357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267017+0000","last_change":"2024-05-10T03:53:37.267017+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267017+0000","last_undegraded":"2024-05-10T03:53:37.267017+0000","last_fullsized":"2024-05-10T03:53:37.267017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273327+0000","last_change":"2024-05-10T03:53:37.273327+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273327+0000","last_undegraded":"2024-05-10T03:53:37.273327+0000","last_fullsized":"2024-05-10T03:53:37.273327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266622+0000","last_change":"2024-05-10T03:53:37.266622+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266622+0000","last_undegraded":"2024-05-10T03:53:37.266622+0000","last_fullsized":"2024-05-10T03:53:37.266622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.275113+0000","last_change":"2024-05-10T03:53:37.275113+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.275113+0000","last_undegraded":"2024-05-10T03:53:37.275113+0000","last_fullsized":"2024-05-10T03:53:37.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270141+0000","last_change":"2024-05-10T03:53:37.270141+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270141+0000","last_undegraded":"2024-05-10T03:53:37.270141+0000","last_fullsized":"2024-05-10T03:53:37.270141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269256+0000","last_change":"2024-05-10T03:53:37.269256+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269256+0000","last_undegraded":"2024-05-10T03:53:37.269256+0000","last_fullsized":"2024-05-10T03:53:37.269256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.275609+0000","last_change":"2024-05-10T03:53:37.275609+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.275609+0000","last_undegraded":"2024-05-10T03:53:37.275609+0000","last_fullsized":"2024-05-10T03:53:37.275609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272883+0000","last_change":"2024-05-10T03:53:37.272883+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272883+0000","last_undegraded":"2024-05-10T03:53:37.272883+0000","last_fullsized":"2024-05-10T03:53:37.272883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266430+0000","last_change":"2024-05-10T03:53:37.266430+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266430+0000","last_undegraded":"2024-05-10T03:53:37.266430+0000","last_fullsized":"2024-05-10T03:53:37.266430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268552+0000","last_change":"2024-05-10T03:53:37.268552+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268552+0000","last_undegraded":"2024-05-10T03:53:37.268552+0000","last_fullsized":"2024-05-10T03:53:37.268552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269735+0000","last_change":"2024-05-10T03:53:37.269735+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269735+0000","last_undegraded":"2024-05-10T03:53:37.269735+0000","last_fullsized":"2024-05-10T03:53:37.269735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.263921+0000","last_change":"2024-05-10T03:53:37.263921+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.263921+0000","last_undegraded":"2024-05-10T03:53:37.263921+0000","last_fullsized":"2024-05-10T03:53:37.263921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.290046+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:37.290046+0000","last_peered":"2024-05-10T03:53:37.290046+0000","last_clean":"2024-05-10T03:53:37.290046+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:37.290046+0000","last_undegraded":"2024-05-10T03:53:37.290046+0000","last_fullsized":"2024-05-10T03:53:37.290046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271640+0000","last_change":"2024-05-10T03:53:37.271640+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271640+0000","last_undegraded":"2024-05-10T03:53:37.271640+0000","last_fullsized":"2024-05-10T03:53:37.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284579+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:37.284579+0000","last_peered":"2024-05-10T03:53:37.284579+0000","last_clean":"2024-05-10T03:53:37.284579+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:37.284579+0000","last_undegraded":"2024-05-10T03:53:37.284579+0000","last_fullsized":"2024-05-10T03:53:37.284579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.289767+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:37.289767+0000","last_peered":"2024-05-10T03:53:37.289767+0000","last_clean":"2024-05-10T03:53:37.289767+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:37.289767+0000","last_undegraded":"2024-05-10T03:53:37.289767+0000","last_fullsized":"2024-05-10T03:53:37.289767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278174+0000","last_change":"2024-05-10T03:53:37.278174+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278174+0000","last_undegraded":"2024-05-10T03:53:37.278174+0000","last_fullsized":"2024-05-10T03:53:37.278174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278767+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:37.278767+0000","last_peered":"2024-05-10T03:53:37.278767+0000","last_clean":"2024-05-10T03:53:37.278767+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:37.278767+0000","last_undegraded":"2024-05-10T03:53:37.278767+0000","last_fullsized":"2024-05-10T03:53:37.278767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270993+0000","last_change":"2024-05-10T03:53:37.270993+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270993+0000","last_undegraded":"2024-05-10T03:53:37.270993+0000","last_fullsized":"2024-05-10T03:53:37.270993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284476+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:37.284476+0000","last_peered":"2024-05-10T03:53:37.284476+0000","last_clean":"2024-05-10T03:53:37.284476+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:37.284476+0000","last_undegraded":"2024-05-10T03:53:37.284476+0000","last_fullsized":"2024-05-10T03:53:37.284476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266043+0000","last_change":"2024-05-10T03:53:37.266043+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266043+0000","last_undegraded":"2024-05-10T03:53:37.266043+0000","last_fullsized":"2024-05-10T03:53:37.266043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.281447+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:37.281447+0000","last_peered":"2024-05-10T03:53:37.281447+0000","last_clean":"2024-05-10T03:53:37.281447+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:37.281447+0000","last_undegraded":"2024-05-10T03:53:37.281447+0000","last_fullsized":"2024-05-10T03:53:37.281447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270632+0000","last_change":"2024-05-10T03:53:37.270632+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270632+0000","last_undegraded":"2024-05-10T03:53:37.270632+0000","last_fullsized":"2024-05-10T03:53:37.270632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.282223+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:37.282223+0000","last_peered":"2024-05-10T03:53:37.282223+0000","last_clean":"2024-05-10T03:53:37.282223+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:37.282223+0000","last_undegraded":"2024-05-10T03:53:37.282223+0000","last_fullsized":"2024-05-10T03:53:37.282223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264038+0000","last_change":"2024-05-10T03:53:37.264038+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264038+0000","last_undegraded":"2024-05-10T03:53:37.264038+0000","last_fullsized":"2024-05-10T03:53:37.264038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.285252+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:37.285252+0000","last_peered":"2024-05-10T03:53:37.285252+0000","last_clean":"2024-05-10T03:53:37.285252+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:37.285252+0000","last_undegraded":"2024-05-10T03:53:37.285252+0000","last_fullsized":"2024-05-10T03:53:37.285252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274520+0000","last_change":"2024-05-10T03:53:37.274520+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274520+0000","last_undegraded":"2024-05-10T03:53:37.274520+0000","last_fullsized":"2024-05-10T03:53:37.274520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.283128+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:37.283128+0000","last_peered":"2024-05-10T03:53:37.283128+0000","last_clean":"2024-05-10T03:53:37.283128+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:37.283128+0000","last_undegraded":"2024-05-10T03:53:37.283128+0000","last_fullsized":"2024-05-10T03:53:37.283128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269795+0000","last_change":"2024-05-10T03:53:37.269795+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269795+0000","last_undegraded":"2024-05-10T03:53:37.269795+0000","last_fullsized":"2024-05-10T03:53:37.269795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.287113+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:37.287113+0000","last_peered":"2024-05-10T03:53:37.287113+0000","last_clean":"2024-05-10T03:53:37.287113+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:37.287113+0000","last_undegraded":"2024-05-10T03:53:37.287113+0000","last_fullsized":"2024-05-10T03:53:37.287113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271375+0000","last_change":"2024-05-10T03:53:37.271375+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271375+0000","last_undegraded":"2024-05-10T03:53:37.271375+0000","last_fullsized":"2024-05-10T03:53:37.271375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278511+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:37.278511+0000","last_peered":"2024-05-10T03:53:37.278511+0000","last_clean":"2024-05-10T03:53:37.278511+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:37.278511+0000","last_undegraded":"2024-05-10T03:53:37.278511+0000","last_fullsized":"2024-05-10T03:53:37.278511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:10.961965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268660+0000","last_change":"2024-05-10T03:53:37.268660+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268660+0000","last_undegraded":"2024-05-10T03:53:37.268660+0000","last_fullsized":"2024-05-10T03:53:37.268660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278208+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:37.278208+0000","last_peered":"2024-05-10T03:53:37.278208+0000","last_clean":"2024-05-10T03:53:37.278208+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:37.278208+0000","last_undegraded":"2024-05-10T03:53:37.278208+0000","last_fullsized":"2024-05-10T03:53:37.278208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:10.961965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272680+0000","last_change":"2024-05-10T03:53:37.272680+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272680+0000","last_undegraded":"2024-05-10T03:53:37.272680+0000","last_fullsized":"2024-05-10T03:53:37.272680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278623+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:37.278623+0000","last_peered":"2024-05-10T03:53:37.278623+0000","last_clean":"2024-05-10T03:53:37.278623+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:37.278623+0000","last_undegraded":"2024-05-10T03:53:37.278623+0000","last_fullsized":"2024-05-10T03:53:37.278623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:29.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271890+0000","last_change":"2024-05-10T03:53:37.271890+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271890+0000","last_undegraded":"2024-05-10T03:53:37.271890+0000","last_fullsized":"2024-05-10T03:53:37.271890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.285031+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:37.285031+0000","last_peered":"2024-05-10T03:53:37.285031+0000","last_clean":"2024-05-10T03:53:37.285031+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:37.285031+0000","last_undegraded":"2024-05-10T03:53:37.285031+0000","last_fullsized":"2024-05-10T03:53:37.285031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.276692+0000","last_change":"2024-05-10T03:53:37.276692+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.276692+0000","last_undegraded":"2024-05-10T03:53:37.276692+0000","last_fullsized":"2024-05-10T03:53:37.276692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278518+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:37.278518+0000","last_peered":"2024-05-10T03:53:37.278518+0000","last_clean":"2024-05-10T03:53:37.278518+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:37.278518+0000","last_undegraded":"2024-05-10T03:53:37.278518+0000","last_fullsized":"2024-05-10T03:53:37.278518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265640+0000","last_change":"2024-05-10T03:53:37.265640+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265640+0000","last_undegraded":"2024-05-10T03:53:37.265640+0000","last_fullsized":"2024-05-10T03:53:37.265640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278174+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:37.278174+0000","last_peered":"2024-05-10T03:53:37.278174+0000","last_clean":"2024-05-10T03:53:37.278174+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:37.278174+0000","last_undegraded":"2024-05-10T03:53:37.278174+0000","last_fullsized":"2024-05-10T03:53:37.278174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271925+0000","last_change":"2024-05-10T03:53:37.271925+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271925+0000","last_undegraded":"2024-05-10T03:53:37.271925+0000","last_fullsized":"2024-05-10T03:53:37.271925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":104,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279202+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:37.279202+0000","last_peered":"2024-05-10T03:53:37.279202+0000","last_clean":"2024-05-10T03:53:37.279202+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:37.279202+0000","last_undegraded":"2024-05-10T03:53:37.279202+0000","last_fullsized":"2024-05-10T03:53:37.279202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.281511+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:37.281511+0000","last_peered":"2024-05-10T03:53:37.281511+0000","last_clean":"2024-05-10T03:53:37.281511+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:37.281511+0000","last_undegraded":"2024-05-10T03:53:37.281511+0000","last_fullsized":"2024-05-10T03:53:37.281511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.282707+0000","last_change":"2024-05-10T03:53:37.282707+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.282707+0000","last_undegraded":"2024-05-10T03:53:37.282707+0000","last_fullsized":"2024-05-10T03:53:37.282707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293203+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:37.293203+0000","last_peered":"2024-05-10T03:53:37.293203+0000","last_clean":"2024-05-10T03:53:37.293203+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:37.293203+0000","last_undegraded":"2024-05-10T03:53:37.293203+0000","last_fullsized":"2024-05-10T03:53:37.293203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269263+0000","last_change":"2024-05-10T03:53:37.269263+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269263+0000","last_undegraded":"2024-05-10T03:53:37.269263+0000","last_fullsized":"2024-05-10T03:53:37.269263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279915+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:37.279915+0000","last_peered":"2024-05-10T03:53:37.279915+0000","last_clean":"2024-05-10T03:53:37.279915+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:37.279915+0000","last_undegraded":"2024-05-10T03:53:37.279915+0000","last_fullsized":"2024-05-10T03:53:37.279915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268771+0000","last_change":"2024-05-10T03:53:37.268771+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268771+0000","last_undegraded":"2024-05-10T03:53:37.268771+0000","last_fullsized":"2024-05-10T03:53:37.268771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279305+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:37.279305+0000","last_peered":"2024-05-10T03:53:37.279305+0000","last_clean":"2024-05-10T03:53:37.279305+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:37.279305+0000","last_undegraded":"2024-05-10T03:53:37.279305+0000","last_fullsized":"2024-05-10T03:53:37.279305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264056+0000","last_change":"2024-05-10T03:53:37.264056+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264056+0000","last_undegraded":"2024-05-10T03:53:37.264056+0000","last_fullsized":"2024-05-10T03:53:37.264056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.282183+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:37.282183+0000","last_peered":"2024-05-10T03:53:37.282183+0000","last_clean":"2024-05-10T03:53:37.282183+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:37.282183+0000","last_undegraded":"2024-05-10T03:53:37.282183+0000","last_fullsized":"2024-05-10T03:53:37.282183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265012+0000","last_change":"2024-05-10T03:53:37.265012+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265012+0000","last_undegraded":"2024-05-10T03:53:37.265012+0000","last_fullsized":"2024-05-10T03:53:37.265012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293214+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:37.293214+0000","last_peered":"2024-05-10T03:53:37.293214+0000","last_clean":"2024-05-10T03:53:37.293214+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:37.293214+0000","last_undegraded":"2024-05-10T03:53:37.293214+0000","last_fullsized":"2024-05-10T03:53:37.293214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267893+0000","last_change":"2024-05-10T03:53:37.267893+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267893+0000","last_undegraded":"2024-05-10T03:53:37.267893+0000","last_fullsized":"2024-05-10T03:53:37.267893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278972+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:37.278972+0000","last_peered":"2024-05-10T03:53:37.278972+0000","last_clean":"2024-05-10T03:53:37.278972+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:37.278972+0000","last_undegraded":"2024-05-10T03:53:37.278972+0000","last_fullsized":"2024-05-10T03:53:37.278972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274632+0000","last_change":"2024-05-10T03:53:37.274632+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274632+0000","last_undegraded":"2024-05-10T03:53:37.274632+0000","last_fullsized":"2024-05-10T03:53:37.274632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293121+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:37.293121+0000","last_peered":"2024-05-10T03:53:37.293121+0000","last_clean":"2024-05-10T03:53:37.293121+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:37.293121+0000","last_undegraded":"2024-05-10T03:53:37.293121+0000","last_fullsized":"2024-05-10T03:53:37.293121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271509+0000","last_change":"2024-05-10T03:53:37.271509+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271509+0000","last_undegraded":"2024-05-10T03:53:37.271509+0000","last_fullsized":"2024-05-10T03:53:37.271509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293162+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:37.293162+0000","last_peered":"2024-05-10T03:53:37.293162+0000","last_clean":"2024-05-10T03:53:37.293162+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:37.293162+0000","last_undegraded":"2024-05-10T03:53:37.293162+0000","last_fullsized":"2024-05-10T03:53:37.293162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265150+0000","last_change":"2024-05-10T03:53:37.265150+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265150+0000","last_undegraded":"2024-05-10T03:53:37.265150+0000","last_fullsized":"2024-05-10T03:53:37.265150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284318+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:37.284318+0000","last_peered":"2024-05-10T03:53:37.284318+0000","last_clean":"2024-05-10T03:53:37.284318+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:37.284318+0000","last_undegraded":"2024-05-10T03:53:37.284318+0000","last_fullsized":"2024-05-10T03:53:37.284318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274069+0000","last_change":"2024-05-10T03:53:37.274069+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274069+0000","last_undegraded":"2024-05-10T03:53:37.274069+0000","last_fullsized":"2024-05-10T03:53:37.274069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.289471+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:37.289471+0000","last_peered":"2024-05-10T03:53:37.289471+0000","last_clean":"2024-05-10T03:53:37.289471+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:37.289471+0000","last_undegraded":"2024-05-10T03:53:37.289471+0000","last_fullsized":"2024-05-10T03:53:37.289471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272921+0000","last_change":"2024-05-10T03:53:37.272921+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272921+0000","last_undegraded":"2024-05-10T03:53:37.272921+0000","last_fullsized":"2024-05-10T03:53:37.272921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293293+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:37.293293+0000","last_peered":"2024-05-10T03:53:37.293293+0000","last_clean":"2024-05-10T03:53:37.293293+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:37.293293+0000","last_undegraded":"2024-05-10T03:53:37.293293+0000","last_fullsized":"2024-05-10T03:53:37.293293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268761+0000","last_change":"2024-05-10T03:53:37.268761+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268761+0000","last_undegraded":"2024-05-10T03:53:37.268761+0000","last_fullsized":"2024-05-10T03:53:37.268761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266554+0000","last_change":"2024-05-10T03:53:37.266554+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266554+0000","last_undegraded":"2024-05-10T03:53:37.266554+0000","last_fullsized":"2024-05-10T03:53:37.266554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293119+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:37.293119+0000","last_peered":"2024-05-10T03:53:37.293119+0000","last_clean":"2024-05-10T03:53:37.293119+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:37.293119+0000","last_undegraded":"2024-05-10T03:53:37.293119+0000","last_fullsized":"2024-05-10T03:53:37.293119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266351+0000","last_change":"2024-05-10T03:53:37.266351+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266351+0000","last_undegraded":"2024-05-10T03:53:37.266351+0000","last_fullsized":"2024-05-10T03:53:37.266351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293239+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:37.293239+0000","last_peered":"2024-05-10T03:53:37.293239+0000","last_clean":"2024-05-10T03:53:37.293239+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:37.293239+0000","last_undegraded":"2024-05-10T03:53:37.293239+0000","last_fullsized":"2024-05-10T03:53:37.293239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272529+0000","last_change":"2024-05-10T03:53:37.272529+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272529+0000","last_undegraded":"2024-05-10T03:53:37.272529+0000","last_fullsized":"2024-05-10T03:53:37.272529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284795+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:37.284795+0000","last_peered":"2024-05-10T03:53:37.284795+0000","last_clean":"2024-05-10T03:53:37.284795+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:37.284795+0000","last_undegraded":"2024-05-10T03:53:37.284795+0000","last_fullsized":"2024-05-10T03:53:37.284795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.277038+0000","last_change":"2024-05-10T03:53:37.277038+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.277038+0000","last_undegraded":"2024-05-10T03:53:37.277038+0000","last_fullsized":"2024-05-10T03:53:37.277038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.288128+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:37.288128+0000","last_peered":"2024-05-10T03:53:37.288128+0000","last_clean":"2024-05-10T03:53:37.288128+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:37.288128+0000","last_undegraded":"2024-05-10T03:53:37.288128+0000","last_fullsized":"2024-05-10T03:53:37.288128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":761856,"data_stored":641566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":761856,"data_stored":641566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:42.340 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.478+0000 7f19196b0640 1 Processor -- start 2024-05-10T03:53:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.478+0000 7f19196b0640 1 -- start start 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.478+0000 7f19196b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1914163cb0 0x7f19140d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.478+0000 7f19196b0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191415f770 0x7f191415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19196b0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191409bcb0 con 0x7f1914163080 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19196b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f191409ba60 con 0x7f1914163cb0 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19196b0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f191409bf90 con 0x7f191415f770 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1914163cb0 0x7f19140d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1914163cb0 0x7f19140d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37340/0 (socket says 172.21.15.55:37340) 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 -- 172.21.15.55:0/3088624070 learned_addr learned my addr 172.21.15.55:0/3088624070 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19137fe640 1 --2- 172.21.15.55:0/3088624070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191415f770 0x7f191415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 -- 172.21.15.55:0/3088624070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191415f770 msgr2=0x7f191415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:42.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 --2- 172.21.15.55:0/3088624070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191415f770 0x7f191415fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 -- 172.21.15.55:0/3088624070 >> v1:172.21.15.64:6789/0 conn(0x7f1914163080 legacy=0x7f1914163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:42.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.479+0000 7f19127fc640 1 -- 172.21.15.55:0/3088624070 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191409c270 con 0x7f1914163cb0 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19127fc640 1 --2- 172.21.15.55:0/3088624070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914163cb0 0x7f19140d1d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1908009870 tx=0x7f190802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269c42751f2dbfb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f1911ffb640 1 -- 172.21.15.55:0/3088624070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908037070 con 0x7f1914163cb0 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f1911ffb640 1 -- 172.21.15.55:0/3088624070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908032440 con 0x7f1914163cb0 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f1911ffb640 1 -- 172.21.15.55:0/3088624070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908032810 con 0x7f1914163cb0 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 -- 172.21.15.55:0/3088624070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914163cb0 msgr2=0x7f19140d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 --2- 172.21.15.55:0/3088624070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914163cb0 0x7f19140d1d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1908009870 tx=0x7f190802a250 comp rx=0 tx=0).stop 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 -- 172.21.15.55:0/3088624070 shutdown_connections 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 --2- 172.21.15.55:0/3088624070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191415f770 0x7f191415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 --2- 172.21.15.55:0/3088624070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914163cb0 0x7f19140d1d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 -- 172.21.15.55:0/3088624070 >> 172.21.15.55:0/3088624070 conn(0x7f19140b4d70 msgr2=0x7f19140b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.480+0000 7f19196b0640 1 -- 172.21.15.55:0/3088624070 shutdown_connections 2024-05-10T03:53:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.481+0000 7f19196b0640 1 -- 172.21.15.55:0/3088624070 wait complete. 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.482+0000 7f19196b0640 1 Processor -- start 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.482+0000 7f19196b0640 1 -- start start 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 0x7f191415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1914163080 0x7f1914070d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1914163cb0 0x7f19140b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f19140d2250 con 0x7f191415f770 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f191409c830 con 0x7f1914163cb0 2024-05-10T03:53:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f19140cef80 con 0x7f1914163080 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 0x7f191415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 0x7f191415d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37348/0 (socket says 172.21.15.55:37348) 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 -- 172.21.15.55:0/611751297 learned_addr learned my addr 172.21.15.55:0/611751297 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19137fe640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1914163cb0 0x7f19140b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19127fc640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1914163080 0x7f1914070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 -- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1914163080 msgr2=0x7f1914070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1914163080 0x7f1914070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 -- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1914163cb0 msgr2=0x7f19140b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1914163cb0 0x7f19140b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 -- 172.21.15.55:0/611751297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19140712a0 con 0x7f191415f770 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19137fe640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1914163cb0 0x7f19140b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f1912ffd640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 0x7f191415d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f190400c430 tx=0x7f190400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904011790 con 0x7f191415f770 2024-05-10T03:53:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1904017070 con 0x7f191415f770 2024-05-10T03:53:42.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19141f67e0 con 0x7f191415f770 2024-05-10T03:53:42.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.483+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904011bb0 con 0x7f191415f770 2024-05-10T03:53:42.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.484+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19141f6500 con 0x7f191415f770 2024-05-10T03:53:42.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.485+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19140a1390 con 0x7f191415f770 2024-05-10T03:53:42.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.485+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f190401c460 con 0x7f191415f770 2024-05-10T03:53:42.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.486+0000 7f18fb7fe640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1900076300 0x7f19000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.486+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19040973f0 con 0x7f191415f770 2024-05-10T03:53:42.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.486+0000 7f19127fc640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1900076300 0x7f19000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.486+0000 7f19127fc640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1900076300 0x7f19000787c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1908034000 tx=0x7f190802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.490+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1904060de0 con 0x7f191415f770 2024-05-10T03:53:42.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.676+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f191415d920 con 0x7f1900076300 2024-05-10T03:53:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.682+0000 7f18fb7fe640 1 -- 172.21.15.55:0/611751297 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246617 (secure 0 0 0) 0x7f190803c460 con 0x7f1900076300 2024-05-10T03:53:42.687 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:42.794 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1900076300 msgr2=0x7f19000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1900076300 0x7f19000787c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1908034000 tx=0x7f190802e000 comp rx=0 tx=0).stop 2024-05-10T03:53:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 msgr2=0x7f191415d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 0x7f191415d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f190400c430 tx=0x7f190400c8f0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 shutdown_connections 2024-05-10T03:53:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1914163cb0 0x7f19140b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1914163080 0x7f1914070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1900076300 0x7f19000787c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 --2- 172.21.15.55:0/611751297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f191415f770 0x7f191415d3e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.685+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 >> 172.21.15.55:0/611751297 conn(0x7f19140b4d70 msgr2=0x7f1914163460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.686+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 shutdown_connections 2024-05-10T03:53:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.686+0000 7f19196b0640 1 -- 172.21.15.55:0/611751297 wait complete. 2024-05-10T03:53:42.800 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-10T03:53:41.782320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":2532,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":2592768,"data_stored":1621695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.522094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278267+0000","last_change":"2024-05-10T03:53:37.278267+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278267+0000","last_undegraded":"2024-05-10T03:53:37.278267+0000","last_fullsized":"2024-05-10T03:53:37.278267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270114+0000","last_change":"2024-05-10T03:53:37.270114+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270114+0000","last_undegraded":"2024-05-10T03:53:37.270114+0000","last_fullsized":"2024-05-10T03:53:37.270114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270139+0000","last_change":"2024-05-10T03:53:37.270139+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270139+0000","last_undegraded":"2024-05-10T03:53:37.270139+0000","last_fullsized":"2024-05-10T03:53:37.270139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268106+0000","last_change":"2024-05-10T03:53:37.268106+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268106+0000","last_undegraded":"2024-05-10T03:53:37.268106+0000","last_fullsized":"2024-05-10T03:53:37.268106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272282+0000","last_change":"2024-05-10T03:53:37.272282+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272282+0000","last_undegraded":"2024-05-10T03:53:37.272282+0000","last_fullsized":"2024-05-10T03:53:37.272282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267681+0000","last_change":"2024-05-10T03:53:37.267681+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267681+0000","last_undegraded":"2024-05-10T03:53:37.267681+0000","last_fullsized":"2024-05-10T03:53:37.267681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.276203+0000","last_change":"2024-05-10T03:53:37.276203+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.276203+0000","last_undegraded":"2024-05-10T03:53:37.276203+0000","last_fullsized":"2024-05-10T03:53:37.276203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278903+0000","last_change":"2024-05-10T03:53:37.278903+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278903+0000","last_undegraded":"2024-05-10T03:53:37.278903+0000","last_fullsized":"2024-05-10T03:53:37.278903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.277629+0000","last_change":"2024-05-10T03:53:37.277629+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.277629+0000","last_undegraded":"2024-05-10T03:53:37.277629+0000","last_fullsized":"2024-05-10T03:53:37.277629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270685+0000","last_change":"2024-05-10T03:53:37.270685+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270685+0000","last_undegraded":"2024-05-10T03:53:37.270685+0000","last_fullsized":"2024-05-10T03:53:37.270685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268945+0000","last_change":"2024-05-10T03:53:37.268945+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268945+0000","last_undegraded":"2024-05-10T03:53:37.268945+0000","last_fullsized":"2024-05-10T03:53:37.268945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264968+0000","last_change":"2024-05-10T03:53:37.264968+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264968+0000","last_undegraded":"2024-05-10T03:53:37.264968+0000","last_fullsized":"2024-05-10T03:53:37.264968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273466+0000","last_change":"2024-05-10T03:53:37.273466+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273466+0000","last_undegraded":"2024-05-10T03:53:37.273466+0000","last_fullsized":"2024-05-10T03:53:37.273466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270376+0000","last_change":"2024-05-10T03:53:37.270376+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270376+0000","last_undegraded":"2024-05-10T03:53:37.270376+0000","last_fullsized":"2024-05-10T03:53:37.270376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270497+0000","last_change":"2024-05-10T03:53:37.270497+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270497+0000","last_undegraded":"2024-05-10T03:53:37.270497+0000","last_fullsized":"2024-05-10T03:53:37.270497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267716+0000","last_change":"2024-05-10T03:53:37.267716+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267716+0000","last_undegraded":"2024-05-10T03:53:37.267716+0000","last_fullsized":"2024-05-10T03:53:37.267716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267083+0000","last_change":"2024-05-10T03:53:37.267083+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267083+0000","last_undegraded":"2024-05-10T03:53:37.267083+0000","last_fullsized":"2024-05-10T03:53:37.267083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269412+0000","last_change":"2024-05-10T03:53:37.269412+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269412+0000","last_undegraded":"2024-05-10T03:53:37.269412+0000","last_fullsized":"2024-05-10T03:53:37.269412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271231+0000","last_change":"2024-05-10T03:53:37.271231+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271231+0000","last_undegraded":"2024-05-10T03:53:37.271231+0000","last_fullsized":"2024-05-10T03:53:37.271231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268672+0000","last_change":"2024-05-10T03:53:37.268672+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268672+0000","last_undegraded":"2024-05-10T03:53:37.268672+0000","last_fullsized":"2024-05-10T03:53:37.268672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273357+0000","last_change":"2024-05-10T03:53:37.273357+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273357+0000","last_undegraded":"2024-05-10T03:53:37.273357+0000","last_fullsized":"2024-05-10T03:53:37.273357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267017+0000","last_change":"2024-05-10T03:53:37.267017+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267017+0000","last_undegraded":"2024-05-10T03:53:37.267017+0000","last_fullsized":"2024-05-10T03:53:37.267017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273327+0000","last_change":"2024-05-10T03:53:37.273327+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273327+0000","last_undegraded":"2024-05-10T03:53:37.273327+0000","last_fullsized":"2024-05-10T03:53:37.273327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266622+0000","last_change":"2024-05-10T03:53:37.266622+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266622+0000","last_undegraded":"2024-05-10T03:53:37.266622+0000","last_fullsized":"2024-05-10T03:53:37.266622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.275113+0000","last_change":"2024-05-10T03:53:37.275113+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.275113+0000","last_undegraded":"2024-05-10T03:53:37.275113+0000","last_fullsized":"2024-05-10T03:53:37.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270141+0000","last_change":"2024-05-10T03:53:37.270141+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270141+0000","last_undegraded":"2024-05-10T03:53:37.270141+0000","last_fullsized":"2024-05-10T03:53:37.270141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269256+0000","last_change":"2024-05-10T03:53:37.269256+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269256+0000","last_undegraded":"2024-05-10T03:53:37.269256+0000","last_fullsized":"2024-05-10T03:53:37.269256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.275609+0000","last_change":"2024-05-10T03:53:37.275609+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.275609+0000","last_undegraded":"2024-05-10T03:53:37.275609+0000","last_fullsized":"2024-05-10T03:53:37.275609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272883+0000","last_change":"2024-05-10T03:53:37.272883+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272883+0000","last_undegraded":"2024-05-10T03:53:37.272883+0000","last_fullsized":"2024-05-10T03:53:37.272883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266430+0000","last_change":"2024-05-10T03:53:37.266430+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266430+0000","last_undegraded":"2024-05-10T03:53:37.266430+0000","last_fullsized":"2024-05-10T03:53:37.266430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268552+0000","last_change":"2024-05-10T03:53:37.268552+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268552+0000","last_undegraded":"2024-05-10T03:53:37.268552+0000","last_fullsized":"2024-05-10T03:53:37.268552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269735+0000","last_change":"2024-05-10T03:53:37.269735+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269735+0000","last_undegraded":"2024-05-10T03:53:37.269735+0000","last_fullsized":"2024-05-10T03:53:37.269735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.263921+0000","last_change":"2024-05-10T03:53:37.263921+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.263921+0000","last_undegraded":"2024-05-10T03:53:37.263921+0000","last_fullsized":"2024-05-10T03:53:37.263921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.290046+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:37.290046+0000","last_peered":"2024-05-10T03:53:37.290046+0000","last_clean":"2024-05-10T03:53:37.290046+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:37.290046+0000","last_undegraded":"2024-05-10T03:53:37.290046+0000","last_fullsized":"2024-05-10T03:53:37.290046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271640+0000","last_change":"2024-05-10T03:53:37.271640+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271640+0000","last_undegraded":"2024-05-10T03:53:37.271640+0000","last_fullsized":"2024-05-10T03:53:37.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284579+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:37.284579+0000","last_peered":"2024-05-10T03:53:37.284579+0000","last_clean":"2024-05-10T03:53:37.284579+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:37.284579+0000","last_undegraded":"2024-05-10T03:53:37.284579+0000","last_fullsized":"2024-05-10T03:53:37.284579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.289767+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:37.289767+0000","last_peered":"2024-05-10T03:53:37.289767+0000","last_clean":"2024-05-10T03:53:37.289767+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:37.289767+0000","last_undegraded":"2024-05-10T03:53:37.289767+0000","last_fullsized":"2024-05-10T03:53:37.289767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278174+0000","last_change":"2024-05-10T03:53:37.278174+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278174+0000","last_undegraded":"2024-05-10T03:53:37.278174+0000","last_fullsized":"2024-05-10T03:53:37.278174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278767+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:37.278767+0000","last_peered":"2024-05-10T03:53:37.278767+0000","last_clean":"2024-05-10T03:53:37.278767+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:37.278767+0000","last_undegraded":"2024-05-10T03:53:37.278767+0000","last_fullsized":"2024-05-10T03:53:37.278767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270993+0000","last_change":"2024-05-10T03:53:37.270993+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270993+0000","last_undegraded":"2024-05-10T03:53:37.270993+0000","last_fullsized":"2024-05-10T03:53:37.270993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284476+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:37.284476+0000","last_peered":"2024-05-10T03:53:37.284476+0000","last_clean":"2024-05-10T03:53:37.284476+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:37.284476+0000","last_undegraded":"2024-05-10T03:53:37.284476+0000","last_fullsized":"2024-05-10T03:53:37.284476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266043+0000","last_change":"2024-05-10T03:53:37.266043+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266043+0000","last_undegraded":"2024-05-10T03:53:37.266043+0000","last_fullsized":"2024-05-10T03:53:37.266043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.281447+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:37.281447+0000","last_peered":"2024-05-10T03:53:37.281447+0000","last_clean":"2024-05-10T03:53:37.281447+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:37.281447+0000","last_undegraded":"2024-05-10T03:53:37.281447+0000","last_fullsized":"2024-05-10T03:53:37.281447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270632+0000","last_change":"2024-05-10T03:53:37.270632+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270632+0000","last_undegraded":"2024-05-10T03:53:37.270632+0000","last_fullsized":"2024-05-10T03:53:37.270632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.282223+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:37.282223+0000","last_peered":"2024-05-10T03:53:37.282223+0000","last_clean":"2024-05-10T03:53:37.282223+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:37.282223+0000","last_undegraded":"2024-05-10T03:53:37.282223+0000","last_fullsized":"2024-05-10T03:53:37.282223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264038+0000","last_change":"2024-05-10T03:53:37.264038+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264038+0000","last_undegraded":"2024-05-10T03:53:37.264038+0000","last_fullsized":"2024-05-10T03:53:37.264038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.285252+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:37.285252+0000","last_peered":"2024-05-10T03:53:37.285252+0000","last_clean":"2024-05-10T03:53:37.285252+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:37.285252+0000","last_undegraded":"2024-05-10T03:53:37.285252+0000","last_fullsized":"2024-05-10T03:53:37.285252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274520+0000","last_change":"2024-05-10T03:53:37.274520+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274520+0000","last_undegraded":"2024-05-10T03:53:37.274520+0000","last_fullsized":"2024-05-10T03:53:37.274520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.283128+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:37.283128+0000","last_peered":"2024-05-10T03:53:37.283128+0000","last_clean":"2024-05-10T03:53:37.283128+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:37.283128+0000","last_undegraded":"2024-05-10T03:53:37.283128+0000","last_fullsized":"2024-05-10T03:53:37.283128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269795+0000","last_change":"2024-05-10T03:53:37.269795+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269795+0000","last_undegraded":"2024-05-10T03:53:37.269795+0000","last_fullsized":"2024-05-10T03:53:37.269795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.287113+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:37.287113+0000","last_peered":"2024-05-10T03:53:37.287113+0000","last_clean":"2024-05-10T03:53:37.287113+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:37.287113+0000","last_undegraded":"2024-05-10T03:53:37.287113+0000","last_fullsized":"2024-05-10T03:53:37.287113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271375+0000","last_change":"2024-05-10T03:53:37.271375+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271375+0000","last_undegraded":"2024-05-10T03:53:37.271375+0000","last_fullsized":"2024-05-10T03:53:37.271375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278511+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:37.278511+0000","last_peered":"2024-05-10T03:53:37.278511+0000","last_clean":"2024-05-10T03:53:37.278511+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:37.278511+0000","last_undegraded":"2024-05-10T03:53:37.278511+0000","last_fullsized":"2024-05-10T03:53:37.278511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:10.961965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268660+0000","last_change":"2024-05-10T03:53:37.268660+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268660+0000","last_undegraded":"2024-05-10T03:53:37.268660+0000","last_fullsized":"2024-05-10T03:53:37.268660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278208+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:37.278208+0000","last_peered":"2024-05-10T03:53:37.278208+0000","last_clean":"2024-05-10T03:53:37.278208+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:37.278208+0000","last_undegraded":"2024-05-10T03:53:37.278208+0000","last_fullsized":"2024-05-10T03:53:37.278208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:10.961965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272680+0000","last_change":"2024-05-10T03:53:37.272680+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272680+0000","last_undegraded":"2024-05-10T03:53:37.272680+0000","last_fullsized":"2024-05-10T03:53:37.272680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278623+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:37.278623+0000","last_peered":"2024-05-10T03:53:37.278623+0000","last_clean":"2024-05-10T03:53:37.278623+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:37.278623+0000","last_undegraded":"2024-05-10T03:53:37.278623+0000","last_fullsized":"2024-05-10T03:53:37.278623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:29.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271890+0000","last_change":"2024-05-10T03:53:37.271890+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271890+0000","last_undegraded":"2024-05-10T03:53:37.271890+0000","last_fullsized":"2024-05-10T03:53:37.271890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.285031+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:37.285031+0000","last_peered":"2024-05-10T03:53:37.285031+0000","last_clean":"2024-05-10T03:53:37.285031+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:37.285031+0000","last_undegraded":"2024-05-10T03:53:37.285031+0000","last_fullsized":"2024-05-10T03:53:37.285031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.276692+0000","last_change":"2024-05-10T03:53:37.276692+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.276692+0000","last_undegraded":"2024-05-10T03:53:37.276692+0000","last_fullsized":"2024-05-10T03:53:37.276692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278518+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:37.278518+0000","last_peered":"2024-05-10T03:53:37.278518+0000","last_clean":"2024-05-10T03:53:37.278518+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:37.278518+0000","last_undegraded":"2024-05-10T03:53:37.278518+0000","last_fullsized":"2024-05-10T03:53:37.278518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265640+0000","last_change":"2024-05-10T03:53:37.265640+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265640+0000","last_undegraded":"2024-05-10T03:53:37.265640+0000","last_fullsized":"2024-05-10T03:53:37.265640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278174+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:37.278174+0000","last_peered":"2024-05-10T03:53:37.278174+0000","last_clean":"2024-05-10T03:53:37.278174+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:37.278174+0000","last_undegraded":"2024-05-10T03:53:37.278174+0000","last_fullsized":"2024-05-10T03:53:37.278174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271925+0000","last_change":"2024-05-10T03:53:37.271925+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271925+0000","last_undegraded":"2024-05-10T03:53:37.271925+0000","last_fullsized":"2024-05-10T03:53:37.271925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":104,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279202+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:37.279202+0000","last_peered":"2024-05-10T03:53:37.279202+0000","last_clean":"2024-05-10T03:53:37.279202+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:37.279202+0000","last_undegraded":"2024-05-10T03:53:37.279202+0000","last_fullsized":"2024-05-10T03:53:37.279202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.281511+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:37.281511+0000","last_peered":"2024-05-10T03:53:37.281511+0000","last_clean":"2024-05-10T03:53:37.281511+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:37.281511+0000","last_undegraded":"2024-05-10T03:53:37.281511+0000","last_fullsized":"2024-05-10T03:53:37.281511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.282707+0000","last_change":"2024-05-10T03:53:37.282707+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.282707+0000","last_undegraded":"2024-05-10T03:53:37.282707+0000","last_fullsized":"2024-05-10T03:53:37.282707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293203+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:37.293203+0000","last_peered":"2024-05-10T03:53:37.293203+0000","last_clean":"2024-05-10T03:53:37.293203+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:37.293203+0000","last_undegraded":"2024-05-10T03:53:37.293203+0000","last_fullsized":"2024-05-10T03:53:37.293203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269263+0000","last_change":"2024-05-10T03:53:37.269263+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269263+0000","last_undegraded":"2024-05-10T03:53:37.269263+0000","last_fullsized":"2024-05-10T03:53:37.269263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279915+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:37.279915+0000","last_peered":"2024-05-10T03:53:37.279915+0000","last_clean":"2024-05-10T03:53:37.279915+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:37.279915+0000","last_undegraded":"2024-05-10T03:53:37.279915+0000","last_fullsized":"2024-05-10T03:53:37.279915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268771+0000","last_change":"2024-05-10T03:53:37.268771+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268771+0000","last_undegraded":"2024-05-10T03:53:37.268771+0000","last_fullsized":"2024-05-10T03:53:37.268771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279305+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:37.279305+0000","last_peered":"2024-05-10T03:53:37.279305+0000","last_clean":"2024-05-10T03:53:37.279305+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:37.279305+0000","last_undegraded":"2024-05-10T03:53:37.279305+0000","last_fullsized":"2024-05-10T03:53:37.279305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264056+0000","last_change":"2024-05-10T03:53:37.264056+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264056+0000","last_undegraded":"2024-05-10T03:53:37.264056+0000","last_fullsized":"2024-05-10T03:53:37.264056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.282183+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:37.282183+0000","last_peered":"2024-05-10T03:53:37.282183+0000","last_clean":"2024-05-10T03:53:37.282183+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:37.282183+0000","last_undegraded":"2024-05-10T03:53:37.282183+0000","last_fullsized":"2024-05-10T03:53:37.282183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265012+0000","last_change":"2024-05-10T03:53:37.265012+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265012+0000","last_undegraded":"2024-05-10T03:53:37.265012+0000","last_fullsized":"2024-05-10T03:53:37.265012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293214+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:37.293214+0000","last_peered":"2024-05-10T03:53:37.293214+0000","last_clean":"2024-05-10T03:53:37.293214+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:37.293214+0000","last_undegraded":"2024-05-10T03:53:37.293214+0000","last_fullsized":"2024-05-10T03:53:37.293214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267893+0000","last_change":"2024-05-10T03:53:37.267893+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267893+0000","last_undegraded":"2024-05-10T03:53:37.267893+0000","last_fullsized":"2024-05-10T03:53:37.267893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278972+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:37.278972+0000","last_peered":"2024-05-10T03:53:37.278972+0000","last_clean":"2024-05-10T03:53:37.278972+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:37.278972+0000","last_undegraded":"2024-05-10T03:53:37.278972+0000","last_fullsized":"2024-05-10T03:53:37.278972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274632+0000","last_change":"2024-05-10T03:53:37.274632+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274632+0000","last_undegraded":"2024-05-10T03:53:37.274632+0000","last_fullsized":"2024-05-10T03:53:37.274632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293121+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:37.293121+0000","last_peered":"2024-05-10T03:53:37.293121+0000","last_clean":"2024-05-10T03:53:37.293121+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:37.293121+0000","last_undegraded":"2024-05-10T03:53:37.293121+0000","last_fullsized":"2024-05-10T03:53:37.293121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271509+0000","last_change":"2024-05-10T03:53:37.271509+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271509+0000","last_undegraded":"2024-05-10T03:53:37.271509+0000","last_fullsized":"2024-05-10T03:53:37.271509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293162+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:37.293162+0000","last_peered":"2024-05-10T03:53:37.293162+0000","last_clean":"2024-05-10T03:53:37.293162+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:37.293162+0000","last_undegraded":"2024-05-10T03:53:37.293162+0000","last_fullsized":"2024-05-10T03:53:37.293162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265150+0000","last_change":"2024-05-10T03:53:37.265150+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265150+0000","last_undegraded":"2024-05-10T03:53:37.265150+0000","last_fullsized":"2024-05-10T03:53:37.265150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284318+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:37.284318+0000","last_peered":"2024-05-10T03:53:37.284318+0000","last_clean":"2024-05-10T03:53:37.284318+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:37.284318+0000","last_undegraded":"2024-05-10T03:53:37.284318+0000","last_fullsized":"2024-05-10T03:53:37.284318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274069+0000","last_change":"2024-05-10T03:53:37.274069+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274069+0000","last_undegraded":"2024-05-10T03:53:37.274069+0000","last_fullsized":"2024-05-10T03:53:37.274069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.289471+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:37.289471+0000","last_peered":"2024-05-10T03:53:37.289471+0000","last_clean":"2024-05-10T03:53:37.289471+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:37.289471+0000","last_undegraded":"2024-05-10T03:53:37.289471+0000","last_fullsized":"2024-05-10T03:53:37.289471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272921+0000","last_change":"2024-05-10T03:53:37.272921+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272921+0000","last_undegraded":"2024-05-10T03:53:37.272921+0000","last_fullsized":"2024-05-10T03:53:37.272921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293293+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:37.293293+0000","last_peered":"2024-05-10T03:53:37.293293+0000","last_clean":"2024-05-10T03:53:37.293293+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:37.293293+0000","last_undegraded":"2024-05-10T03:53:37.293293+0000","last_fullsized":"2024-05-10T03:53:37.293293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268761+0000","last_change":"2024-05-10T03:53:37.268761+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268761+0000","last_undegraded":"2024-05-10T03:53:37.268761+0000","last_fullsized":"2024-05-10T03:53:37.268761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266554+0000","last_change":"2024-05-10T03:53:37.266554+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266554+0000","last_undegraded":"2024-05-10T03:53:37.266554+0000","last_fullsized":"2024-05-10T03:53:37.266554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293119+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:37.293119+0000","last_peered":"2024-05-10T03:53:37.293119+0000","last_clean":"2024-05-10T03:53:37.293119+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:37.293119+0000","last_undegraded":"2024-05-10T03:53:37.293119+0000","last_fullsized":"2024-05-10T03:53:37.293119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266351+0000","last_change":"2024-05-10T03:53:37.266351+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266351+0000","last_undegraded":"2024-05-10T03:53:37.266351+0000","last_fullsized":"2024-05-10T03:53:37.266351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293239+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:37.293239+0000","last_peered":"2024-05-10T03:53:37.293239+0000","last_clean":"2024-05-10T03:53:37.293239+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:37.293239+0000","last_undegraded":"2024-05-10T03:53:37.293239+0000","last_fullsized":"2024-05-10T03:53:37.293239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272529+0000","last_change":"2024-05-10T03:53:37.272529+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272529+0000","last_undegraded":"2024-05-10T03:53:37.272529+0000","last_fullsized":"2024-05-10T03:53:37.272529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284795+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:37.284795+0000","last_peered":"2024-05-10T03:53:37.284795+0000","last_clean":"2024-05-10T03:53:37.284795+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:37.284795+0000","last_undegraded":"2024-05-10T03:53:37.284795+0000","last_fullsized":"2024-05-10T03:53:37.284795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.277038+0000","last_change":"2024-05-10T03:53:37.277038+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.277038+0000","last_undegraded":"2024-05-10T03:53:37.277038+0000","last_fullsized":"2024-05-10T03:53:37.277038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.288128+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:37.288128+0000","last_peered":"2024-05-10T03:53:37.288128+0000","last_clean":"2024-05-10T03:53:37.288128+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:37.288128+0000","last_undegraded":"2024-05-10T03:53:37.288128+0000","last_fullsized":"2024-05-10T03:53:37.288128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":761856,"data_stored":641566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":761856,"data_stored":641566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:42.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:42.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 Processor -- start 2024-05-10T03:53:42.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 -- start start 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a50162aa0 0x7f0a500d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0a500d1d40 0x7f0a500d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a500d3b90 con 0x7f0a500d3690 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f0a500d5170 con 0x7f0a50162aa0 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.909+0000 7f0a562c4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f0a500d3e70 con 0x7f0a500d1d40 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a50162aa0 0x7f0a500d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a50162aa0 0x7f0a500d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37354/0 (socket says 172.21.15.55:37354) 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 -- 172.21.15.55:0/2995704714 learned_addr learned my addr 172.21.15.55:0/2995704714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:42.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a47fff640 1 --1- 172.21.15.55:0/2995704714 >> v1:172.21.15.55:6789/0 conn(0x7f0a500d3690 0x7f0a500bac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57902/0 (socket says 172.21.15.55:57902) 2024-05-10T03:53:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a54861640 1 --2- 172.21.15.55:0/2995704714 >> v2:172.21.15.64:3300/0 conn(0x7f0a500d1d40 0x7f0a500d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 -- 172.21.15.55:0/2995704714 >> v2:172.21.15.64:3300/0 conn(0x7f0a500d1d40 msgr2=0x7f0a500d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 --2- 172.21.15.55:0/2995704714 >> v2:172.21.15.64:3300/0 conn(0x7f0a500d1d40 0x7f0a500d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 -- 172.21.15.55:0/2995704714 >> v1:172.21.15.55:6789/0 conn(0x7f0a500d3690 legacy=0x7f0a500bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.910+0000 7f0a4ffff640 1 -- 172.21.15.55:0/2995704714 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a500d4150 con 0x7f0a50162aa0 2024-05-10T03:53:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a4ffff640 1 --2- 172.21.15.55:0/2995704714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a50162aa0 0x7f0a500d4c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a5008e6f0 tx=0x7f0a4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d56d2b748eeea6b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a4f7fe640 1 -- 172.21.15.55:0/2995704714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40037070 con 0x7f0a50162aa0 2024-05-10T03:53:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a4f7fe640 1 -- 172.21.15.55:0/2995704714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a40032440 con 0x7f0a50162aa0 2024-05-10T03:53:42.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a4f7fe640 1 -- 172.21.15.55:0/2995704714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40032810 con 0x7f0a50162aa0 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 -- 172.21.15.55:0/2995704714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a50162aa0 msgr2=0x7f0a500d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2995704714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a50162aa0 0x7f0a500d4c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a5008e6f0 tx=0x7f0a4002a270 comp rx=0 tx=0).stop 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 -- 172.21.15.55:0/2995704714 shutdown_connections 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2995704714 >> v2:172.21.15.64:3300/0 conn(0x7f0a500d1d40 0x7f0a500d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2995704714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a50162aa0 0x7f0a500d4c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 -- 172.21.15.55:0/2995704714 >> 172.21.15.55:0/2995704714 conn(0x7f0a500740f0 msgr2=0x7f0a5006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.911+0000 7f0a562c4640 1 -- 172.21.15.55:0/2995704714 shutdown_connections 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.912+0000 7f0a562c4640 1 -- 172.21.15.55:0/2995704714 wait complete. 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 Processor -- start 2024-05-10T03:53:42.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 -- start start 2024-05-10T03:53:42.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500d1d40 0x7f0a500ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 0x7f0a5015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a50162aa0 0x7f0a5015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0a500b8460 con 0x7f0a500d3690 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0a500d4710 con 0x7f0a50162aa0 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a562c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0a500b85e0 con 0x7f0a500d1d40 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 0x7f0a5015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 0x7f0a5015ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37366/0 (socket says 172.21.15.55:37366) 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.913+0000 7f0a47fff640 1 -- 172.21.15.55:0/2864555520 learned_addr learned my addr 172.21.15.55:0/2864555520 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a54861640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a50162aa0 0x7f0a5015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a47fff640 1 -- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500d1d40 msgr2=0x7f0a500ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a47fff640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500d1d40 0x7f0a500ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a47fff640 1 -- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a50162aa0 msgr2=0x7f0a5015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a47fff640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a50162aa0 0x7f0a5015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a47fff640 1 -- 172.21.15.55:0/2864555520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a501f5560 con 0x7f0a500d3690 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a54861640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a50162aa0 0x7f0a5015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a47fff640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 0x7f0a5015ec40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c500 tx=0x7f0a3800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38018070 con 0x7f0a500d3690 2024-05-10T03:53:42.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a38007500 con 0x7f0a500d3690 2024-05-10T03:53:42.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a380049e0 con 0x7f0a500d3690 2024-05-10T03:53:42.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a501f5840 con 0x7f0a500d3690 2024-05-10T03:53:42.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.914+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a501f5230 con 0x7f0a500d3690 2024-05-10T03:53:42.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.915+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a500cf250 con 0x7f0a500d3690 2024-05-10T03:53:42.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.916+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a3801b070 con 0x7f0a500d3690 2024-05-10T03:53:42.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.916+0000 7f0a4d7fa640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0a300762d0 0x7f0a30078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:42.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.916+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a38096a10 con 0x7f0a500d3690 2024-05-10T03:53:42.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.916+0000 7f0a4ffff640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0a300762d0 0x7f0a30078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:42.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.917+0000 7f0a4ffff640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0a300762d0 0x7f0a30078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a40034000 tx=0x7f0a4002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:42.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:42.921+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0a500cf250 con 0x7f0a500d3690 2024-05-10T03:53:43.024 INFO:tasks.ceph.mds.b.smithi064.stderr:2024-05-10T03:53:43.021+0000 7f02106c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T03:53:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.109+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a5006e7a0 con 0x7f0a300762d0 2024-05-10T03:53:43.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.115+0000 7f0a4d7fa640 1 -- 172.21.15.55:0/2864555520 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246617 (secure 0 0 0) 0x7f0a5006e7a0 con 0x7f0a300762d0 2024-05-10T03:53:43.120 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0a300762d0 msgr2=0x7f0a30078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0a300762d0 0x7f0a30078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a40034000 tx=0x7f0a4002c000 comp rx=0 tx=0).stop 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 msgr2=0x7f0a5015ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 0x7f0a5015ec40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c500 tx=0x7f0a3800c9c0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 shutdown_connections 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a50162aa0 0x7f0a5015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0a300762d0 0x7f0a30078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a500d3690 0x7f0a5015ec40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 --2- 172.21.15.55:0/2864555520 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500d1d40 0x7f0a500ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 >> 172.21.15.55:0/2864555520 conn(0x7f0a500740f0 msgr2=0x7f0a500cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 shutdown_connections 2024-05-10T03:53:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.118+0000 7f0a562c4640 1 -- 172.21.15.55:0/2864555520 wait complete. 2024-05-10T03:53:43.132 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-10T03:53:41.782320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":2532,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":2592768,"data_stored":1621695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.522094"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278267+0000","last_change":"2024-05-10T03:53:37.278267+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278267+0000","last_undegraded":"2024-05-10T03:53:37.278267+0000","last_fullsized":"2024-05-10T03:53:37.278267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270114+0000","last_change":"2024-05-10T03:53:37.270114+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270114+0000","last_undegraded":"2024-05-10T03:53:37.270114+0000","last_fullsized":"2024-05-10T03:53:37.270114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270139+0000","last_change":"2024-05-10T03:53:37.270139+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270139+0000","last_undegraded":"2024-05-10T03:53:37.270139+0000","last_fullsized":"2024-05-10T03:53:37.270139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268106+0000","last_change":"2024-05-10T03:53:37.268106+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268106+0000","last_undegraded":"2024-05-10T03:53:37.268106+0000","last_fullsized":"2024-05-10T03:53:37.268106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272282+0000","last_change":"2024-05-10T03:53:37.272282+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272282+0000","last_undegraded":"2024-05-10T03:53:37.272282+0000","last_fullsized":"2024-05-10T03:53:37.272282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267681+0000","last_change":"2024-05-10T03:53:37.267681+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267681+0000","last_undegraded":"2024-05-10T03:53:37.267681+0000","last_fullsized":"2024-05-10T03:53:37.267681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.276203+0000","last_change":"2024-05-10T03:53:37.276203+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.276203+0000","last_undegraded":"2024-05-10T03:53:37.276203+0000","last_fullsized":"2024-05-10T03:53:37.276203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278903+0000","last_change":"2024-05-10T03:53:37.278903+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278903+0000","last_undegraded":"2024-05-10T03:53:37.278903+0000","last_fullsized":"2024-05-10T03:53:37.278903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.277629+0000","last_change":"2024-05-10T03:53:37.277629+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.277629+0000","last_undegraded":"2024-05-10T03:53:37.277629+0000","last_fullsized":"2024-05-10T03:53:37.277629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270685+0000","last_change":"2024-05-10T03:53:37.270685+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270685+0000","last_undegraded":"2024-05-10T03:53:37.270685+0000","last_fullsized":"2024-05-10T03:53:37.270685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268945+0000","last_change":"2024-05-10T03:53:37.268945+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268945+0000","last_undegraded":"2024-05-10T03:53:37.268945+0000","last_fullsized":"2024-05-10T03:53:37.268945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264968+0000","last_change":"2024-05-10T03:53:37.264968+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264968+0000","last_undegraded":"2024-05-10T03:53:37.264968+0000","last_fullsized":"2024-05-10T03:53:37.264968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273466+0000","last_change":"2024-05-10T03:53:37.273466+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273466+0000","last_undegraded":"2024-05-10T03:53:37.273466+0000","last_fullsized":"2024-05-10T03:53:37.273466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270376+0000","last_change":"2024-05-10T03:53:37.270376+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270376+0000","last_undegraded":"2024-05-10T03:53:37.270376+0000","last_fullsized":"2024-05-10T03:53:37.270376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270497+0000","last_change":"2024-05-10T03:53:37.270497+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270497+0000","last_undegraded":"2024-05-10T03:53:37.270497+0000","last_fullsized":"2024-05-10T03:53:37.270497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267716+0000","last_change":"2024-05-10T03:53:37.267716+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267716+0000","last_undegraded":"2024-05-10T03:53:37.267716+0000","last_fullsized":"2024-05-10T03:53:37.267716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267083+0000","last_change":"2024-05-10T03:53:37.267083+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267083+0000","last_undegraded":"2024-05-10T03:53:37.267083+0000","last_fullsized":"2024-05-10T03:53:37.267083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269412+0000","last_change":"2024-05-10T03:53:37.269412+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269412+0000","last_undegraded":"2024-05-10T03:53:37.269412+0000","last_fullsized":"2024-05-10T03:53:37.269412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271231+0000","last_change":"2024-05-10T03:53:37.271231+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271231+0000","last_undegraded":"2024-05-10T03:53:37.271231+0000","last_fullsized":"2024-05-10T03:53:37.271231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268672+0000","last_change":"2024-05-10T03:53:37.268672+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268672+0000","last_undegraded":"2024-05-10T03:53:37.268672+0000","last_fullsized":"2024-05-10T03:53:37.268672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273357+0000","last_change":"2024-05-10T03:53:37.273357+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273357+0000","last_undegraded":"2024-05-10T03:53:37.273357+0000","last_fullsized":"2024-05-10T03:53:37.273357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267017+0000","last_change":"2024-05-10T03:53:37.267017+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267017+0000","last_undegraded":"2024-05-10T03:53:37.267017+0000","last_fullsized":"2024-05-10T03:53:37.267017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.273327+0000","last_change":"2024-05-10T03:53:37.273327+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.273327+0000","last_undegraded":"2024-05-10T03:53:37.273327+0000","last_fullsized":"2024-05-10T03:53:37.273327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266622+0000","last_change":"2024-05-10T03:53:37.266622+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266622+0000","last_undegraded":"2024-05-10T03:53:37.266622+0000","last_fullsized":"2024-05-10T03:53:37.266622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.275113+0000","last_change":"2024-05-10T03:53:37.275113+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.275113+0000","last_undegraded":"2024-05-10T03:53:37.275113+0000","last_fullsized":"2024-05-10T03:53:37.275113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270141+0000","last_change":"2024-05-10T03:53:37.270141+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270141+0000","last_undegraded":"2024-05-10T03:53:37.270141+0000","last_fullsized":"2024-05-10T03:53:37.270141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269256+0000","last_change":"2024-05-10T03:53:37.269256+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269256+0000","last_undegraded":"2024-05-10T03:53:37.269256+0000","last_fullsized":"2024-05-10T03:53:37.269256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.275609+0000","last_change":"2024-05-10T03:53:37.275609+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.275609+0000","last_undegraded":"2024-05-10T03:53:37.275609+0000","last_fullsized":"2024-05-10T03:53:37.275609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272883+0000","last_change":"2024-05-10T03:53:37.272883+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272883+0000","last_undegraded":"2024-05-10T03:53:37.272883+0000","last_fullsized":"2024-05-10T03:53:37.272883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266430+0000","last_change":"2024-05-10T03:53:37.266430+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266430+0000","last_undegraded":"2024-05-10T03:53:37.266430+0000","last_fullsized":"2024-05-10T03:53:37.266430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268552+0000","last_change":"2024-05-10T03:53:37.268552+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268552+0000","last_undegraded":"2024-05-10T03:53:37.268552+0000","last_fullsized":"2024-05-10T03:53:37.268552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269735+0000","last_change":"2024-05-10T03:53:37.269735+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269735+0000","last_undegraded":"2024-05-10T03:53:37.269735+0000","last_fullsized":"2024-05-10T03:53:37.269735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.263921+0000","last_change":"2024-05-10T03:53:37.263921+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.263921+0000","last_undegraded":"2024-05-10T03:53:37.263921+0000","last_fullsized":"2024-05-10T03:53:37.263921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.290046+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:37.290046+0000","last_peered":"2024-05-10T03:53:37.290046+0000","last_clean":"2024-05-10T03:53:37.290046+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:37.290046+0000","last_undegraded":"2024-05-10T03:53:37.290046+0000","last_fullsized":"2024-05-10T03:53:37.290046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271640+0000","last_change":"2024-05-10T03:53:37.271640+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271640+0000","last_undegraded":"2024-05-10T03:53:37.271640+0000","last_fullsized":"2024-05-10T03:53:37.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284579+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:37.284579+0000","last_peered":"2024-05-10T03:53:37.284579+0000","last_clean":"2024-05-10T03:53:37.284579+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:37.284579+0000","last_undegraded":"2024-05-10T03:53:37.284579+0000","last_fullsized":"2024-05-10T03:53:37.284579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.289767+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:37.289767+0000","last_peered":"2024-05-10T03:53:37.289767+0000","last_clean":"2024-05-10T03:53:37.289767+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:37.289767+0000","last_undegraded":"2024-05-10T03:53:37.289767+0000","last_fullsized":"2024-05-10T03:53:37.289767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.278174+0000","last_change":"2024-05-10T03:53:37.278174+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.278174+0000","last_undegraded":"2024-05-10T03:53:37.278174+0000","last_fullsized":"2024-05-10T03:53:37.278174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278767+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:37.278767+0000","last_peered":"2024-05-10T03:53:37.278767+0000","last_clean":"2024-05-10T03:53:37.278767+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:37.278767+0000","last_undegraded":"2024-05-10T03:53:37.278767+0000","last_fullsized":"2024-05-10T03:53:37.278767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270993+0000","last_change":"2024-05-10T03:53:37.270993+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270993+0000","last_undegraded":"2024-05-10T03:53:37.270993+0000","last_fullsized":"2024-05-10T03:53:37.270993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284476+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:37.284476+0000","last_peered":"2024-05-10T03:53:37.284476+0000","last_clean":"2024-05-10T03:53:37.284476+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:37.284476+0000","last_undegraded":"2024-05-10T03:53:37.284476+0000","last_fullsized":"2024-05-10T03:53:37.284476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266043+0000","last_change":"2024-05-10T03:53:37.266043+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266043+0000","last_undegraded":"2024-05-10T03:53:37.266043+0000","last_fullsized":"2024-05-10T03:53:37.266043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.281447+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:37.281447+0000","last_peered":"2024-05-10T03:53:37.281447+0000","last_clean":"2024-05-10T03:53:37.281447+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:37.281447+0000","last_undegraded":"2024-05-10T03:53:37.281447+0000","last_fullsized":"2024-05-10T03:53:37.281447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.270632+0000","last_change":"2024-05-10T03:53:37.270632+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.270632+0000","last_undegraded":"2024-05-10T03:53:37.270632+0000","last_fullsized":"2024-05-10T03:53:37.270632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.282223+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:37.282223+0000","last_peered":"2024-05-10T03:53:37.282223+0000","last_clean":"2024-05-10T03:53:37.282223+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:37.282223+0000","last_undegraded":"2024-05-10T03:53:37.282223+0000","last_fullsized":"2024-05-10T03:53:37.282223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264038+0000","last_change":"2024-05-10T03:53:37.264038+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264038+0000","last_undegraded":"2024-05-10T03:53:37.264038+0000","last_fullsized":"2024-05-10T03:53:37.264038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.285252+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:37.285252+0000","last_peered":"2024-05-10T03:53:37.285252+0000","last_clean":"2024-05-10T03:53:37.285252+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:37.285252+0000","last_undegraded":"2024-05-10T03:53:37.285252+0000","last_fullsized":"2024-05-10T03:53:37.285252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274520+0000","last_change":"2024-05-10T03:53:37.274520+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274520+0000","last_undegraded":"2024-05-10T03:53:37.274520+0000","last_fullsized":"2024-05-10T03:53:37.274520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.283128+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:37.283128+0000","last_peered":"2024-05-10T03:53:37.283128+0000","last_clean":"2024-05-10T03:53:37.283128+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:37.283128+0000","last_undegraded":"2024-05-10T03:53:37.283128+0000","last_fullsized":"2024-05-10T03:53:37.283128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269795+0000","last_change":"2024-05-10T03:53:37.269795+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269795+0000","last_undegraded":"2024-05-10T03:53:37.269795+0000","last_fullsized":"2024-05-10T03:53:37.269795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.287113+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:37.287113+0000","last_peered":"2024-05-10T03:53:37.287113+0000","last_clean":"2024-05-10T03:53:37.287113+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:37.287113+0000","last_undegraded":"2024-05-10T03:53:37.287113+0000","last_fullsized":"2024-05-10T03:53:37.287113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271375+0000","last_change":"2024-05-10T03:53:37.271375+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271375+0000","last_undegraded":"2024-05-10T03:53:37.271375+0000","last_fullsized":"2024-05-10T03:53:37.271375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278511+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:37.278511+0000","last_peered":"2024-05-10T03:53:37.278511+0000","last_clean":"2024-05-10T03:53:37.278511+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:37.278511+0000","last_undegraded":"2024-05-10T03:53:37.278511+0000","last_fullsized":"2024-05-10T03:53:37.278511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:10.961965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268660+0000","last_change":"2024-05-10T03:53:37.268660+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268660+0000","last_undegraded":"2024-05-10T03:53:37.268660+0000","last_fullsized":"2024-05-10T03:53:37.268660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278208+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:37.278208+0000","last_peered":"2024-05-10T03:53:37.278208+0000","last_clean":"2024-05-10T03:53:37.278208+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:37.278208+0000","last_undegraded":"2024-05-10T03:53:37.278208+0000","last_fullsized":"2024-05-10T03:53:37.278208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:10.961965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272680+0000","last_change":"2024-05-10T03:53:37.272680+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272680+0000","last_undegraded":"2024-05-10T03:53:37.272680+0000","last_fullsized":"2024-05-10T03:53:37.272680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278623+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:37.278623+0000","last_peered":"2024-05-10T03:53:37.278623+0000","last_clean":"2024-05-10T03:53:37.278623+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:37.278623+0000","last_undegraded":"2024-05-10T03:53:37.278623+0000","last_fullsized":"2024-05-10T03:53:37.278623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:29.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271890+0000","last_change":"2024-05-10T03:53:37.271890+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271890+0000","last_undegraded":"2024-05-10T03:53:37.271890+0000","last_fullsized":"2024-05-10T03:53:37.271890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.285031+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:37.285031+0000","last_peered":"2024-05-10T03:53:37.285031+0000","last_clean":"2024-05-10T03:53:37.285031+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:37.285031+0000","last_undegraded":"2024-05-10T03:53:37.285031+0000","last_fullsized":"2024-05-10T03:53:37.285031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.276692+0000","last_change":"2024-05-10T03:53:37.276692+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.276692+0000","last_undegraded":"2024-05-10T03:53:37.276692+0000","last_fullsized":"2024-05-10T03:53:37.276692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278518+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:37.278518+0000","last_peered":"2024-05-10T03:53:37.278518+0000","last_clean":"2024-05-10T03:53:37.278518+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:37.278518+0000","last_undegraded":"2024-05-10T03:53:37.278518+0000","last_fullsized":"2024-05-10T03:53:37.278518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265640+0000","last_change":"2024-05-10T03:53:37.265640+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265640+0000","last_undegraded":"2024-05-10T03:53:37.265640+0000","last_fullsized":"2024-05-10T03:53:37.265640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278174+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:37.278174+0000","last_peered":"2024-05-10T03:53:37.278174+0000","last_clean":"2024-05-10T03:53:37.278174+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:37.278174+0000","last_undegraded":"2024-05-10T03:53:37.278174+0000","last_fullsized":"2024-05-10T03:53:37.278174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:49.594890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271925+0000","last_change":"2024-05-10T03:53:37.271925+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271925+0000","last_undegraded":"2024-05-10T03:53:37.271925+0000","last_fullsized":"2024-05-10T03:53:37.271925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":104,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279202+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:37.279202+0000","last_peered":"2024-05-10T03:53:37.279202+0000","last_clean":"2024-05-10T03:53:37.279202+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:37.279202+0000","last_undegraded":"2024-05-10T03:53:37.279202+0000","last_fullsized":"2024-05-10T03:53:37.279202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.281511+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:37.281511+0000","last_peered":"2024-05-10T03:53:37.281511+0000","last_clean":"2024-05-10T03:53:37.281511+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:37.281511+0000","last_undegraded":"2024-05-10T03:53:37.281511+0000","last_fullsized":"2024-05-10T03:53:37.281511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.282707+0000","last_change":"2024-05-10T03:53:37.282707+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.282707+0000","last_undegraded":"2024-05-10T03:53:37.282707+0000","last_fullsized":"2024-05-10T03:53:37.282707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293203+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:37.293203+0000","last_peered":"2024-05-10T03:53:37.293203+0000","last_clean":"2024-05-10T03:53:37.293203+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:37.293203+0000","last_undegraded":"2024-05-10T03:53:37.293203+0000","last_fullsized":"2024-05-10T03:53:37.293203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.269263+0000","last_change":"2024-05-10T03:53:37.269263+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.269263+0000","last_undegraded":"2024-05-10T03:53:37.269263+0000","last_fullsized":"2024-05-10T03:53:37.269263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279915+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:37.279915+0000","last_peered":"2024-05-10T03:53:37.279915+0000","last_clean":"2024-05-10T03:53:37.279915+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:37.279915+0000","last_undegraded":"2024-05-10T03:53:37.279915+0000","last_fullsized":"2024-05-10T03:53:37.279915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268771+0000","last_change":"2024-05-10T03:53:37.268771+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268771+0000","last_undegraded":"2024-05-10T03:53:37.268771+0000","last_fullsized":"2024-05-10T03:53:37.268771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.279305+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:37.279305+0000","last_peered":"2024-05-10T03:53:37.279305+0000","last_clean":"2024-05-10T03:53:37.279305+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:37.279305+0000","last_undegraded":"2024-05-10T03:53:37.279305+0000","last_fullsized":"2024-05-10T03:53:37.279305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.264056+0000","last_change":"2024-05-10T03:53:37.264056+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.264056+0000","last_undegraded":"2024-05-10T03:53:37.264056+0000","last_fullsized":"2024-05-10T03:53:37.264056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.282183+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:37.282183+0000","last_peered":"2024-05-10T03:53:37.282183+0000","last_clean":"2024-05-10T03:53:37.282183+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:37.282183+0000","last_undegraded":"2024-05-10T03:53:37.282183+0000","last_fullsized":"2024-05-10T03:53:37.282183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265012+0000","last_change":"2024-05-10T03:53:37.265012+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265012+0000","last_undegraded":"2024-05-10T03:53:37.265012+0000","last_fullsized":"2024-05-10T03:53:37.265012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293214+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:37.293214+0000","last_peered":"2024-05-10T03:53:37.293214+0000","last_clean":"2024-05-10T03:53:37.293214+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:37.293214+0000","last_undegraded":"2024-05-10T03:53:37.293214+0000","last_fullsized":"2024-05-10T03:53:37.293214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.267893+0000","last_change":"2024-05-10T03:53:37.267893+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.267893+0000","last_undegraded":"2024-05-10T03:53:37.267893+0000","last_fullsized":"2024-05-10T03:53:37.267893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.278972+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:37.278972+0000","last_peered":"2024-05-10T03:53:37.278972+0000","last_clean":"2024-05-10T03:53:37.278972+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:37.278972+0000","last_undegraded":"2024-05-10T03:53:37.278972+0000","last_fullsized":"2024-05-10T03:53:37.278972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274632+0000","last_change":"2024-05-10T03:53:37.274632+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274632+0000","last_undegraded":"2024-05-10T03:53:37.274632+0000","last_fullsized":"2024-05-10T03:53:37.274632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293121+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:37.293121+0000","last_peered":"2024-05-10T03:53:37.293121+0000","last_clean":"2024-05-10T03:53:37.293121+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:37.293121+0000","last_undegraded":"2024-05-10T03:53:37.293121+0000","last_fullsized":"2024-05-10T03:53:37.293121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.271509+0000","last_change":"2024-05-10T03:53:37.271509+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.271509+0000","last_undegraded":"2024-05-10T03:53:37.271509+0000","last_fullsized":"2024-05-10T03:53:37.271509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293162+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:37.293162+0000","last_peered":"2024-05-10T03:53:37.293162+0000","last_clean":"2024-05-10T03:53:37.293162+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:37.293162+0000","last_undegraded":"2024-05-10T03:53:37.293162+0000","last_fullsized":"2024-05-10T03:53:37.293162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.265150+0000","last_change":"2024-05-10T03:53:37.265150+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.265150+0000","last_undegraded":"2024-05-10T03:53:37.265150+0000","last_fullsized":"2024-05-10T03:53:37.265150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284318+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:37.284318+0000","last_peered":"2024-05-10T03:53:37.284318+0000","last_clean":"2024-05-10T03:53:37.284318+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:37.284318+0000","last_undegraded":"2024-05-10T03:53:37.284318+0000","last_fullsized":"2024-05-10T03:53:37.284318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.274069+0000","last_change":"2024-05-10T03:53:37.274069+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.274069+0000","last_undegraded":"2024-05-10T03:53:37.274069+0000","last_fullsized":"2024-05-10T03:53:37.274069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.289471+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:37.289471+0000","last_peered":"2024-05-10T03:53:37.289471+0000","last_clean":"2024-05-10T03:53:37.289471+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:37.289471+0000","last_undegraded":"2024-05-10T03:53:37.289471+0000","last_fullsized":"2024-05-10T03:53:37.289471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272921+0000","last_change":"2024-05-10T03:53:37.272921+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272921+0000","last_undegraded":"2024-05-10T03:53:37.272921+0000","last_fullsized":"2024-05-10T03:53:37.272921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293293+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:37.293293+0000","last_peered":"2024-05-10T03:53:37.293293+0000","last_clean":"2024-05-10T03:53:37.293293+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:37.293293+0000","last_undegraded":"2024-05-10T03:53:37.293293+0000","last_fullsized":"2024-05-10T03:53:37.293293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.268761+0000","last_change":"2024-05-10T03:53:37.268761+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.268761+0000","last_undegraded":"2024-05-10T03:53:37.268761+0000","last_fullsized":"2024-05-10T03:53:37.268761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266554+0000","last_change":"2024-05-10T03:53:37.266554+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266554+0000","last_undegraded":"2024-05-10T03:53:37.266554+0000","last_fullsized":"2024-05-10T03:53:37.266554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293119+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:37.293119+0000","last_peered":"2024-05-10T03:53:37.293119+0000","last_clean":"2024-05-10T03:53:37.293119+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:37.293119+0000","last_undegraded":"2024-05-10T03:53:37.293119+0000","last_fullsized":"2024-05-10T03:53:37.293119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:20:10.494301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.266351+0000","last_change":"2024-05-10T03:53:37.266351+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.266351+0000","last_undegraded":"2024-05-10T03:53:37.266351+0000","last_fullsized":"2024-05-10T03:53:37.266351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.293239+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:37.293239+0000","last_peered":"2024-05-10T03:53:37.293239+0000","last_clean":"2024-05-10T03:53:37.293239+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:37.293239+0000","last_undegraded":"2024-05-10T03:53:37.293239+0000","last_fullsized":"2024-05-10T03:53:37.293239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.272529+0000","last_change":"2024-05-10T03:53:37.272529+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.272529+0000","last_undegraded":"2024-05-10T03:53:37.272529+0000","last_fullsized":"2024-05-10T03:53:37.272529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.284795+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:37.284795+0000","last_peered":"2024-05-10T03:53:37.284795+0000","last_clean":"2024-05-10T03:53:37.284795+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:37.284795+0000","last_undegraded":"2024-05-10T03:53:37.284795+0000","last_fullsized":"2024-05-10T03:53:37.284795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-10T03:53:37.277038+0000","last_change":"2024-05-10T03:53:37.277038+0000","last_active":"2024-05-10T03:53:37.248548+0000","last_peered":"2024-05-10T03:53:37.248548+0000","last_clean":"2024-05-10T03:53:37.248548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:53:37.277038+0000","last_undegraded":"2024-05-10T03:53:37.277038+0000","last_fullsized":"2024-05-10T03:53:37.277038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-10T03:53:37.288128+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:37.288128+0000","last_peered":"2024-05-10T03:53:37.288128+0000","last_clean":"2024-05-10T03:53:37.288128+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:37.288128+0000","last_undegraded":"2024-05-10T03:53:37.288128+0000","last_fullsized":"2024-05-10T03:53:37.288128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":761856,"data_stored":641566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":761856,"data_stored":641566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:43.135 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-05-10T03:53:43.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.278267+0000', 'last_change': '2024-05-10T03:53:37.278267+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.278267+0000', 'last_undegraded': '2024-05-10T03:53:37.278267+0000', 'last_fullsized': '2024-05-10T03:53:37.278267+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270114+0000', 'last_change': '2024-05-10T03:53:37.270114+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270114+0000', 'last_undegraded': '2024-05-10T03:53:37.270114+0000', 'last_fullsized': '2024-05-10T03:53:37.270114+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270139+0000', 'last_change': '2024-05-10T03:53:37.270139+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270139+0000', 'last_undegraded': '2024-05-10T03:53:37.270139+0000', 'last_fullsized': '2024-05-10T03:53:37.270139+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268106+0000', 'last_change': '2024-05-10T03:53:37.268106+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268106+0000', 'last_undegraded': '2024-05-10T03:53:37.268106+0000', 'last_fullsized': '2024-05-10T03:53:37.268106+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.272282+0000', 'last_change': '2024-05-10T03:53:37.272282+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.272282+0000', 'last_undegraded': '2024-05-10T03:53:37.272282+0000', 'last_fullsized': '2024-05-10T03:53:37.272282+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-05-10T03:53:43.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.267681+0000', 'last_change': '2024-05-10T03:53:37.267681+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.267681+0000', 'last_undegraded': '2024-05-10T03:53:37.267681+0000', 'last_fullsized': '2024-05-10T03:53:37.267681+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.276203+0000', 'last_change': '2024-05-10T03:53:37.276203+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.276203+0000', 'last_undegraded': '2024-05-10T03:53:37.276203+0000', 'last_fullsized': '2024-05-10T03:53:37.276203+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.278903+0000', 'last_change': '2024-05-10T03:53:37.278903+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.278903+0000', 'last_undegraded': '2024-05-10T03:53:37.278903+0000', 'last_fullsized': '2024-05-10T03:53:37.278903+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.277629+0000', 'last_change': '2024-05-10T03:53:37.277629+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.277629+0000', 'last_undegraded': '2024-05-10T03:53:37.277629+0000', 'last_fullsized': '2024-05-10T03:53:37.277629+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270685+0000', 'last_change': '2024-05-10T03:53:37.270685+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270685+0000', 'last_undegraded': '2024-05-10T03:53:37.270685+0000', 'last_fullsized': '2024-05-10T03:53:37.270685+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268945+0000', 'last_change': '2024-05-10T03:53:37.268945+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268945+0000', 'last_undegraded': '2024-05-10T03:53:37.268945+0000', 'last_fullsized': '2024-05-10T03:53:37.268945+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-05-10T03:53:43.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.264968+0000', 'last_change': '2024-05-10T03:53:37.264968+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.264968+0000', 'last_undegraded': '2024-05-10T03:53:37.264968+0000', 'last_fullsized': '2024-05-10T03:53:37.264968+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.273466+0000', 'last_change': '2024-05-10T03:53:37.273466+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.273466+0000', 'last_undegraded': '2024-05-10T03:53:37.273466+0000', 'last_fullsized': '2024-05-10T03:53:37.273466+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270376+0000', 'last_change': '2024-05-10T03:53:37.270376+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270376+0000', 'last_undegraded': '2024-05-10T03:53:37.270376+0000', 'last_fullsized': '2024-05-10T03:53:37.270376+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270497+0000', 'last_change': '2024-05-10T03:53:37.270497+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270497+0000', 'last_undegraded': '2024-05-10T03:53:37.270497+0000', 'last_fullsized': '2024-05-10T03:53:37.270497+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.267716+0000', 'last_change': '2024-05-10T03:53:37.267716+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.267716+0000', 'last_undegraded': '2024-05-10T03:53:37.267716+0000', 'last_fullsized': '2024-05-10T03:53:37.267716+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.267083+0000', 'last_change': '2024-05-10T03:53:37.267083+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.267083+0000', 'last_undegraded': '2024-05-10T03:53:37.267083+0000', 'last_fullsized': '2024-05-10T03:53:37.267083+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.269412+0000', 'last_change': '2024-05-10T03:53:37.269412+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.269412+0000', 'last_undegraded': '2024-05-10T03:53:37.269412+0000', 'last_fullsized': '2024-05-10T03:53:37.269412+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.271231+0000', 'last_change': '2024-05-10T03:53:37.271231+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.271231+0000', 'last_undegraded': '2024-05-10T03:53:37.271231+0000', 'last_fullsized': '2024-05-10T03:53:37.271231+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268672+0000', 'last_change': '2024-05-10T03:53:37.268672+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268672+0000', 'last_undegraded': '2024-05-10T03:53:37.268672+0000', 'last_fullsized': '2024-05-10T03:53:37.268672+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.273357+0000', 'last_change': '2024-05-10T03:53:37.273357+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.273357+0000', 'last_undegraded': '2024-05-10T03:53:37.273357+0000', 'last_fullsized': '2024-05-10T03:53:37.273357+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.267017+0000', 'last_change': '2024-05-10T03:53:37.267017+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.267017+0000', 'last_undegraded': '2024-05-10T03:53:37.267017+0000', 'last_fullsized': '2024-05-10T03:53:37.267017+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.273327+0000', 'last_change': '2024-05-10T03:53:37.273327+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.273327+0000', 'last_undegraded': '2024-05-10T03:53:37.273327+0000', 'last_fullsized': '2024-05-10T03:53:37.273327+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.266622+0000', 'last_change': '2024-05-10T03:53:37.266622+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.266622+0000', 'last_undegraded': '2024-05-10T03:53:37.266622+0000', 'last_fullsized': '2024-05-10T03:53:37.266622+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.275113+0000', 'last_change': '2024-05-10T03:53:37.275113+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.275113+0000', 'last_undegraded': '2024-05-10T03:53:37.275113+0000', 'last_fullsized': '2024-05-10T03:53:37.275113+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270141+0000', 'last_change': '2024-05-10T03:53:37.270141+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270141+0000', 'last_undegraded': '2024-05-10T03:53:37.270141+0000', 'last_fullsized': '2024-05-10T03:53:37.270141+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.269256+0000', 'last_change': '2024-05-10T03:53:37.269256+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.269256+0000', 'last_undegraded': '2024-05-10T03:53:37.269256+0000', 'last_fullsized': '2024-05-10T03:53:37.269256+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.275609+0000', 'last_change': '2024-05-10T03:53:37.275609+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.275609+0000', 'last_undegraded': '2024-05-10T03:53:37.275609+0000', 'last_fullsized': '2024-05-10T03:53:37.275609+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.272883+0000', 'last_change': '2024-05-10T03:53:37.272883+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.272883+0000', 'last_undegraded': '2024-05-10T03:53:37.272883+0000', 'last_fullsized': '2024-05-10T03:53:37.272883+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-05-10T03:53:43.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.266430+0000', 'last_change': '2024-05-10T03:53:37.266430+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.266430+0000', 'last_undegraded': '2024-05-10T03:53:37.266430+0000', 'last_fullsized': '2024-05-10T03:53:37.266430+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268552+0000', 'last_change': '2024-05-10T03:53:37.268552+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268552+0000', 'last_undegraded': '2024-05-10T03:53:37.268552+0000', 'last_fullsized': '2024-05-10T03:53:37.268552+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.269735+0000', 'last_change': '2024-05-10T03:53:37.269735+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.269735+0000', 'last_undegraded': '2024-05-10T03:53:37.269735+0000', 'last_fullsized': '2024-05-10T03:53:37.269735+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.263921+0000', 'last_change': '2024-05-10T03:53:37.263921+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.263921+0000', 'last_undegraded': '2024-05-10T03:53:37.263921+0000', 'last_fullsized': '2024-05-10T03:53:37.263921+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.271640+0000', 'last_change': '2024-05-10T03:53:37.271640+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.271640+0000', 'last_undegraded': '2024-05-10T03:53:37.271640+0000', 'last_fullsized': '2024-05-10T03:53:37.271640+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.278174+0000', 'last_change': '2024-05-10T03:53:37.278174+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.278174+0000', 'last_undegraded': '2024-05-10T03:53:37.278174+0000', 'last_fullsized': '2024-05-10T03:53:37.278174+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-05-10T03:53:43.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270993+0000', 'last_change': '2024-05-10T03:53:37.270993+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270993+0000', 'last_undegraded': '2024-05-10T03:53:37.270993+0000', 'last_fullsized': '2024-05-10T03:53:37.270993+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.266043+0000', 'last_change': '2024-05-10T03:53:37.266043+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.266043+0000', 'last_undegraded': '2024-05-10T03:53:37.266043+0000', 'last_fullsized': '2024-05-10T03:53:37.266043+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.270632+0000', 'last_change': '2024-05-10T03:53:37.270632+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.270632+0000', 'last_undegraded': '2024-05-10T03:53:37.270632+0000', 'last_fullsized': '2024-05-10T03:53:37.270632+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.264038+0000', 'last_change': '2024-05-10T03:53:37.264038+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.264038+0000', 'last_undegraded': '2024-05-10T03:53:37.264038+0000', 'last_fullsized': '2024-05-10T03:53:37.264038+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.274520+0000', 'last_change': '2024-05-10T03:53:37.274520+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.274520+0000', 'last_undegraded': '2024-05-10T03:53:37.274520+0000', 'last_fullsized': '2024-05-10T03:53:37.274520+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.269795+0000', 'last_change': '2024-05-10T03:53:37.269795+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.269795+0000', 'last_undegraded': '2024-05-10T03:53:37.269795+0000', 'last_fullsized': '2024-05-10T03:53:37.269795+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-05-10T03:53:43.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.271375+0000', 'last_change': '2024-05-10T03:53:37.271375+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.271375+0000', 'last_undegraded': '2024-05-10T03:53:37.271375+0000', 'last_fullsized': '2024-05-10T03:53:37.271375+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268660+0000', 'last_change': '2024-05-10T03:53:37.268660+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268660+0000', 'last_undegraded': '2024-05-10T03:53:37.268660+0000', 'last_fullsized': '2024-05-10T03:53:37.268660+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.272680+0000', 'last_change': '2024-05-10T03:53:37.272680+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.272680+0000', 'last_undegraded': '2024-05-10T03:53:37.272680+0000', 'last_fullsized': '2024-05-10T03:53:37.272680+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.271890+0000', 'last_change': '2024-05-10T03:53:37.271890+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.271890+0000', 'last_undegraded': '2024-05-10T03:53:37.271890+0000', 'last_fullsized': '2024-05-10T03:53:37.271890+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.276692+0000', 'last_change': '2024-05-10T03:53:37.276692+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.276692+0000', 'last_undegraded': '2024-05-10T03:53:37.276692+0000', 'last_fullsized': '2024-05-10T03:53:37.276692+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.265640+0000', 'last_change': '2024-05-10T03:53:37.265640+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.265640+0000', 'last_undegraded': '2024-05-10T03:53:37.265640+0000', 'last_fullsized': '2024-05-10T03:53:37.265640+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-05-10T03:53:43.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.271925+0000', 'last_change': '2024-05-10T03:53:37.271925+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.271925+0000', 'last_undegraded': '2024-05-10T03:53:37.271925+0000', 'last_fullsized': '2024-05-10T03:53:37.271925+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.282707+0000', 'last_change': '2024-05-10T03:53:37.282707+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.282707+0000', 'last_undegraded': '2024-05-10T03:53:37.282707+0000', 'last_fullsized': '2024-05-10T03:53:37.282707+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.269263+0000', 'last_change': '2024-05-10T03:53:37.269263+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.269263+0000', 'last_undegraded': '2024-05-10T03:53:37.269263+0000', 'last_fullsized': '2024-05-10T03:53:37.269263+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268771+0000', 'last_change': '2024-05-10T03:53:37.268771+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268771+0000', 'last_undegraded': '2024-05-10T03:53:37.268771+0000', 'last_fullsized': '2024-05-10T03:53:37.268771+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.264056+0000', 'last_change': '2024-05-10T03:53:37.264056+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.264056+0000', 'last_undegraded': '2024-05-10T03:53:37.264056+0000', 'last_fullsized': '2024-05-10T03:53:37.264056+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.265012+0000', 'last_change': '2024-05-10T03:53:37.265012+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.265012+0000', 'last_undegraded': '2024-05-10T03:53:37.265012+0000', 'last_fullsized': '2024-05-10T03:53:37.265012+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-05-10T03:53:43.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.267893+0000', 'last_change': '2024-05-10T03:53:37.267893+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.267893+0000', 'last_undegraded': '2024-05-10T03:53:37.267893+0000', 'last_fullsized': '2024-05-10T03:53:37.267893+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.274632+0000', 'last_change': '2024-05-10T03:53:37.274632+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.274632+0000', 'last_undegraded': '2024-05-10T03:53:37.274632+0000', 'last_fullsized': '2024-05-10T03:53:37.274632+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.271509+0000', 'last_change': '2024-05-10T03:53:37.271509+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.271509+0000', 'last_undegraded': '2024-05-10T03:53:37.271509+0000', 'last_fullsized': '2024-05-10T03:53:37.271509+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.265150+0000', 'last_change': '2024-05-10T03:53:37.265150+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.265150+0000', 'last_undegraded': '2024-05-10T03:53:37.265150+0000', 'last_fullsized': '2024-05-10T03:53:37.265150+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.274069+0000', 'last_change': '2024-05-10T03:53:37.274069+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.274069+0000', 'last_undegraded': '2024-05-10T03:53:37.274069+0000', 'last_fullsized': '2024-05-10T03:53:37.274069+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.272921+0000', 'last_change': '2024-05-10T03:53:37.272921+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.272921+0000', 'last_undegraded': '2024-05-10T03:53:37.272921+0000', 'last_fullsized': '2024-05-10T03:53:37.272921+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-05-10T03:53:43.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.268761+0000', 'last_change': '2024-05-10T03:53:37.268761+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.268761+0000', 'last_undegraded': '2024-05-10T03:53:37.268761+0000', 'last_fullsized': '2024-05-10T03:53:37.268761+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.266554+0000', 'last_change': '2024-05-10T03:53:37.266554+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.266554+0000', 'last_undegraded': '2024-05-10T03:53:37.266554+0000', 'last_fullsized': '2024-05-10T03:53:37.266554+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.266351+0000', 'last_change': '2024-05-10T03:53:37.266351+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.266351+0000', 'last_undegraded': '2024-05-10T03:53:37.266351+0000', 'last_fullsized': '2024-05-10T03:53:37.266351+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.272529+0000', 'last_change': '2024-05-10T03:53:37.272529+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.272529+0000', 'last_undegraded': '2024-05-10T03:53:37.272529+0000', 'last_fullsized': '2024-05-10T03:53:37.272529+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-05-10T03:53:43.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-10T03:53:37.277038+0000', 'last_change': '2024-05-10T03:53:37.277038+0000', 'last_active': '2024-05-10T03:53:37.248548+0000', 'last_peered': '2024-05-10T03:53:37.248548+0000', 'last_clean': '2024-05-10T03:53:37.248548+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-10T03:53:37.277038+0000', 'last_undegraded': '2024-05-10T03:53:37.277038+0000', 'last_fullsized': '2024-05-10T03:53:37.277038+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'last_clean_scrub_stamp': '2024-05-10T03:53:37.248548+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-10T03:53:43.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-10T03:53:43.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.271+0000 7f8529951640 1 Processor -- start 2024-05-10T03:53:43.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.271+0000 7f8529951640 1 -- start start 2024-05-10T03:53:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f8529951640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f85240ce390 0x7f85240d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f8529951640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85240ceed0 0x7f8524162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f8529951640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85240cd530 con 0x7f85240cd150 2024-05-10T03:53:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f8529951640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f852415f9b0 con 0x7f85240ceed0 2024-05-10T03:53:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f8529951640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f85240d0f20 con 0x7f85240ce390 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85240ceed0 0x7f8524162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85240ceed0 0x7f8524162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37378/0 (socket says 172.21.15.55:37378) 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 -- 172.21.15.55:0/1582966415 learned_addr learned my addr 172.21.15.55:0/1582966415 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85227fc640 1 --2- 172.21.15.55:0/1582966415 >> v2:172.21.15.64:3300/0 conn(0x7f85240ce390 0x7f85240d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 -- 172.21.15.55:0/1582966415 >> v2:172.21.15.64:3300/0 conn(0x7f85240ce390 msgr2=0x7f85240d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 --2- 172.21.15.55:0/1582966415 >> v2:172.21.15.64:3300/0 conn(0x7f85240ce390 0x7f85240d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 -- 172.21.15.55:0/1582966415 >> v1:172.21.15.55:6789/0 conn(0x7f85240cd150 legacy=0x7f85240cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f8521ffb640 1 -- 172.21.15.55:0/1582966415 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335285130 0 0) 0x7f85240cd530 con 0x7f85240cd150 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.272+0000 7f85237fe640 1 -- 172.21.15.55:0/1582966415 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852415fc10 con 0x7f85240ceed0 2024-05-10T03:53:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.273+0000 7f85237fe640 1 --2- 172.21.15.55:0/1582966415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ceed0 0x7f8524162fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8524164090 tx=0x7f851c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb12d091573450 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.273+0000 7f8521ffb640 1 -- 172.21.15.55:0/1582966415 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c036070 con 0x7f85240ceed0 2024-05-10T03:53:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.273+0000 7f8521ffb640 1 -- 172.21.15.55:0/1582966415 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851c031600 con 0x7f85240ceed0 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.273+0000 7f8521ffb640 1 -- 172.21.15.55:0/1582966415 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c0319d0 con 0x7f85240ceed0 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 -- 172.21.15.55:0/1582966415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ceed0 msgr2=0x7f8524162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 --2- 172.21.15.55:0/1582966415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ceed0 0x7f8524162fd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8524164090 tx=0x7f851c02a6a0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 -- 172.21.15.55:0/1582966415 shutdown_connections 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 --2- 172.21.15.55:0/1582966415 >> v2:172.21.15.64:3300/0 conn(0x7f85240ce390 0x7f85240d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 --2- 172.21.15.55:0/1582966415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ceed0 0x7f8524162fd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 -- 172.21.15.55:0/1582966415 >> 172.21.15.55:0/1582966415 conn(0x7f85240b2e10 msgr2=0x7f85240b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 -- 172.21.15.55:0/1582966415 shutdown_connections 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.274+0000 7f8529951640 1 -- 172.21.15.55:0/1582966415 wait complete. 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.275+0000 7f8529951640 1 Processor -- start 2024-05-10T03:53:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.275+0000 7f8529951640 1 -- start start 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8529951640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f85240cd150 0x7f852415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8529951640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 0x7f852415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8529951640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240ceed0 0x7f8524154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8529951640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f85240706f0 con 0x7f85240ce390 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8529951640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85241601d0 con 0x7f85240ceed0 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8529951640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f85241606f0 con 0x7f85240cd150 2024-05-10T03:53:43.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 0x7f852415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 0x7f852415cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37384/0 (socket says 172.21.15.55:37384) 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 -- 172.21.15.55:0/969625743 learned_addr learned my addr 172.21.15.55:0/969625743 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85237fe640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240ceed0 0x7f8524154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8522ffd640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f85240cd150 0x7f852415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 -- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f85240cd150 msgr2=0x7f852415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f85240cd150 0x7f852415b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 -- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240ceed0 msgr2=0x7f8524154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240ceed0 0x7f8524154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 -- 172.21.15.55:0/969625743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8524154590 con 0x7f85240ce390 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f8522ffd640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f85240cd150 0x7f852415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.276+0000 7f85227fc640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 0x7f852415cf20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f850c00e870 tx=0x7f850c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.277+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c017070 con 0x7f85240ce390 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.277+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850c00c940 con 0x7f85240ce390 2024-05-10T03:53:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.277+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c00cd30 con 0x7f85240ce390 2024-05-10T03:53:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.277+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85240c9bc0 con 0x7f85240ce390 2024-05-10T03:53:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.277+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85240ca180 con 0x7f85240ce390 2024-05-10T03:53:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.278+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852406a7e0 con 0x7f85240ce390 2024-05-10T03:53:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.278+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f850c01a070 con 0x7f85240ce390 2024-05-10T03:53:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.279+0000 7f851bfff640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8504076300 0x7f85040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.279+0000 7f8522ffd640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8504076300 0x7f85040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.279+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f850c0973b0 con 0x7f85240ce390 2024-05-10T03:53:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.279+0000 7f8522ffd640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8504076300 0x7f85040787c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8514000f60 tx=0x7f8514009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:43.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.283+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f850c0606c0 con 0x7f85240ce390 2024-05-10T03:53:43.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.551+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f85240b7280 con 0x7f85240ce390 2024-05-10T03:53:43.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.551+0000 7f851bfff640 1 -- 172.21.15.55:0/969625743 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1032 (secure 0 0 0) 0x7f850c0649c0 con 0x7f85240ce390 2024-05-10T03:53:43.554 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:43.554 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":22,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1715313211,"num_in_osds":8,"osd_in_since":1715313203,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241500160,"bytes_avail":772852613120,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4272}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-10T03:53:21.317894+0000","services":{}},"progress_events":{}} 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8504076300 msgr2=0x7f85040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8504076300 0x7f85040787c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8514000f60 tx=0x7f8514009040 comp rx=0 tx=0).stop 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 msgr2=0x7f852415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 0x7f852415cf20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f850c00e870 tx=0x7f850c00ed30 comp rx=0 tx=0).stop 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 shutdown_connections 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85240ceed0 0x7f8524154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8504076300 0x7f85040787c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85240ce390 0x7f852415cf20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 --2- 172.21.15.55:0/969625743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f85240cd150 0x7f852415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 >> 172.21.15.55:0/969625743 conn(0x7f85240b2e10 msgr2=0x7f852406ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 shutdown_connections 2024-05-10T03:53:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.553+0000 7f8529951640 1 -- 172.21.15.55:0/969625743 wait complete. 2024-05-10T03:53:43.567 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-10T03:53:43.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:43.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.668+0000 7f838db89640 1 Processor -- start 2024-05-10T03:53:43.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.668+0000 7f838db89640 1 -- start start 2024-05-10T03:53:43.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f838db89640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8388162aa0 0x7f83880d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f838db89640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f838db89640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83880d3b90 con 0x7f83880d1d40 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f838db89640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f83880d5170 con 0x7f8388162aa0 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f838db89640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f83880d3e70 con 0x7f83880d3690 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f837ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f83877fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8388162aa0 0x7f83880d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f8387fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f83880d1d40 0x7f83880b8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:47126/0 (socket says 172.21.15.55:47126) 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f8387fff640 1 -- 172.21.15.55:0/147526623 learned_addr learned my addr 172.21.15.55:0/147526623 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f8386ffd640 1 -- 172.21.15.55:0/147526623 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870713338 0 0) 0x7f83880d3b90 con 0x7f83880d1d40 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.669+0000 7f8386ffd640 1 -- 172.21.15.55:0/147526623 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8374003520 con 0x7f83880d1d40 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.670+0000 7f837ffff640 1 -- 172.21.15.55:0/147526623 >> v2:172.21.15.64:3300/0 conn(0x7f8388162aa0 msgr2=0x7f83880d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.670+0000 7f837ffff640 1 --2- 172.21.15.55:0/147526623 >> v2:172.21.15.64:3300/0 conn(0x7f8388162aa0 0x7f83880d4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.670+0000 7f837ffff640 1 -- 172.21.15.55:0/147526623 >> v1:172.21.15.64:6789/0 conn(0x7f83880d1d40 legacy=0x7f83880b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.670+0000 7f837ffff640 1 -- 172.21.15.55:0/147526623 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880d4150 con 0x7f83880d3690 2024-05-10T03:53:43.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.670+0000 7f83877fe640 1 --2- 172.21.15.55:0/147526623 >> v2:172.21.15.64:3300/0 conn(0x7f8388162aa0 0x7f83880d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.670+0000 7f837ffff640 1 --2- 172.21.15.55:0/147526623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880bac50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f83700097a0 tx=0x7f837002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=586065d7dffc59b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f8386ffd640 1 -- 172.21.15.55:0/147526623 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370037070 con 0x7f83880d3690 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f8386ffd640 1 -- 172.21.15.55:0/147526623 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370032440 con 0x7f83880d3690 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f8386ffd640 1 -- 172.21.15.55:0/147526623 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370032810 con 0x7f83880d3690 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 -- 172.21.15.55:0/147526623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 msgr2=0x7f83880bac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 --2- 172.21.15.55:0/147526623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880bac50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f83700097a0 tx=0x7f837002a180 comp rx=0 tx=0).stop 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 -- 172.21.15.55:0/147526623 shutdown_connections 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 --2- 172.21.15.55:0/147526623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880bac50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 --2- 172.21.15.55:0/147526623 >> v2:172.21.15.64:3300/0 conn(0x7f8388162aa0 0x7f83880d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 -- 172.21.15.55:0/147526623 >> 172.21.15.55:0/147526623 conn(0x7f83880740f0 msgr2=0x7f838806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:43.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 -- 172.21.15.55:0/147526623 shutdown_connections 2024-05-10T03:53:43.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.671+0000 7f838db89640 1 -- 172.21.15.55:0/147526623 wait complete. 2024-05-10T03:53:43.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.672+0000 7f838db89640 1 Processor -- start 2024-05-10T03:53:43.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.672+0000 7f838db89640 1 -- start start 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f838db89640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880d1d40 0x7f83880baab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f838db89640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f838db89640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 0x7f838815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f838db89640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f83880bb190 con 0x7f8388162aa0 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f838db89640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f83880d4710 con 0x7f83880d1d40 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f838db89640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f83880d21a0 con 0x7f83880d3690 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f8387fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 0x7f838815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f8387fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 0x7f838815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37400/0 (socket says 172.21.15.55:37400) 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f8387fff640 1 -- 172.21.15.55:0/1511425406 learned_addr learned my addr 172.21.15.55:0/1511425406 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:43.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f83877fe640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880d1d40 0x7f83880baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.673+0000 7f837ffff640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8387fff640 1 -- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 msgr2=0x7f83880c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8387fff640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8387fff640 1 -- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880d1d40 msgr2=0x7f83880baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8387fff640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880d1d40 0x7f83880baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8387fff640 1 -- 172.21.15.55:0/1511425406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880cee00 con 0x7f8388162aa0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f83877fe640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880d1d40 0x7f83880baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8387fff640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 0x7f838815c1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f838000cb40 tx=0x7f838000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838000ac40 con 0x7f8388162aa0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838000ade0 con 0x7f8388162aa0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838815b6e0 con 0x7f8388162aa0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380012600 con 0x7f8388162aa0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.674+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838815bca0 con 0x7f8388162aa0 2024-05-10T03:53:43.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.675+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838806e7a0 con 0x7f8388162aa0 2024-05-10T03:53:43.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.676+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83800127a0 con 0x7f8388162aa0 2024-05-10T03:53:43.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.676+0000 7f8384ff9640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8368076300 0x7f83680787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:43.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.676+0000 7f83877fe640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8368076300 0x7f83680787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:43.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.676+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8380097b80 con 0x7f8388162aa0 2024-05-10T03:53:43.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.677+0000 7f83877fe640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8368076300 0x7f83680787c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f83880c8b90 tx=0x7f8378008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:43.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.681+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8380061570 con 0x7f8388162aa0 2024-05-10T03:53:43.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.867+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83880cf0e0 con 0x7f8368076300 2024-05-10T03:53:43.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.873+0000 7f8384ff9640 1 -- 172.21.15.55:0/1511425406 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f8378011980 con 0x7f8368076300 2024-05-10T03:53:43.878 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:43.879 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8368076300 msgr2=0x7f83680787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8368076300 0x7f83680787c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f83880c8b90 tx=0x7f8378008040 comp rx=0 tx=0).stop 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 msgr2=0x7f838815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 0x7f838815c1c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f838000cb40 tx=0x7f838000a060 comp rx=0 tx=0).stop 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 shutdown_connections 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8368076300 0x7f83680787c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8388162aa0 0x7f838815c1c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f83880d3690 0x7f83880c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 --2- 172.21.15.55:0/1511425406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83880d1d40 0x7f83880baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 >> 172.21.15.55:0/1511425406 conn(0x7f83880740f0 msgr2=0x7f838815f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:43.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 shutdown_connections 2024-05-10T03:53:43.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:43.876+0000 7f838db89640 1 -- 172.21.15.55:0/1511425406 wait complete. 2024-05-10T03:53:43.890 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-10T03:53:43.782649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236136,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738584,"statfs":{"total":773094113280,"available":772852310016,"internally_reserved":0,"allocated":2891776,"data_stored":1749940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.522423"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739883+0000","last_change":"2024-05-10T03:53:38.288661+0000","last_active":"2024-05-10T03:53:39.739883+0000","last_peered":"2024-05-10T03:53:39.739883+0000","last_clean":"2024-05-10T03:53:39.739883+0000","last_became_active":"2024-05-10T03:53:38.287374+0000","last_became_peered":"2024-05-10T03:53:38.287374+0000","last_unstale":"2024-05-10T03:53:39.739883+0000","last_undegraded":"2024-05-10T03:53:39.739883+0000","last_fullsized":"2024-05-10T03:53:39.739883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265472+0000","last_change":"2024-05-10T03:53:38.272836+0000","last_active":"2024-05-10T03:53:39.265472+0000","last_peered":"2024-05-10T03:53:39.265472+0000","last_clean":"2024-05-10T03:53:39.265472+0000","last_became_active":"2024-05-10T03:53:38.272458+0000","last_became_peered":"2024-05-10T03:53:38.272458+0000","last_unstale":"2024-05-10T03:53:39.265472+0000","last_undegraded":"2024-05-10T03:53:39.265472+0000","last_fullsized":"2024-05-10T03:53:39.265472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739779+0000","last_change":"2024-05-10T03:53:38.268359+0000","last_active":"2024-05-10T03:53:39.739779+0000","last_peered":"2024-05-10T03:53:39.739779+0000","last_clean":"2024-05-10T03:53:39.739779+0000","last_became_active":"2024-05-10T03:53:38.268051+0000","last_became_peered":"2024-05-10T03:53:38.268051+0000","last_unstale":"2024-05-10T03:53:39.739779+0000","last_undegraded":"2024-05-10T03:53:39.739779+0000","last_fullsized":"2024-05-10T03:53:39.739779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:48.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264426+0000","last_change":"2024-05-10T03:53:38.293481+0000","last_active":"2024-05-10T03:53:39.264426+0000","last_peered":"2024-05-10T03:53:39.264426+0000","last_clean":"2024-05-10T03:53:39.264426+0000","last_became_active":"2024-05-10T03:53:38.293159+0000","last_became_peered":"2024-05-10T03:53:38.293159+0000","last_unstale":"2024-05-10T03:53:39.264426+0000","last_undegraded":"2024-05-10T03:53:39.264426+0000","last_fullsized":"2024-05-10T03:53:39.264426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739524+0000","last_change":"2024-05-10T03:53:38.294420+0000","last_active":"2024-05-10T03:53:39.739524+0000","last_peered":"2024-05-10T03:53:39.739524+0000","last_clean":"2024-05-10T03:53:39.739524+0000","last_became_active":"2024-05-10T03:53:38.294120+0000","last_became_peered":"2024-05-10T03:53:38.294120+0000","last_unstale":"2024-05-10T03:53:39.739524+0000","last_undegraded":"2024-05-10T03:53:39.739524+0000","last_fullsized":"2024-05-10T03:53:39.739524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264398+0000","last_change":"2024-05-10T03:53:38.272472+0000","last_active":"2024-05-10T03:53:39.264398+0000","last_peered":"2024-05-10T03:53:39.264398+0000","last_clean":"2024-05-10T03:53:39.264398+0000","last_became_active":"2024-05-10T03:53:38.272160+0000","last_became_peered":"2024-05-10T03:53:38.272160+0000","last_unstale":"2024-05-10T03:53:39.264398+0000","last_undegraded":"2024-05-10T03:53:39.264398+0000","last_fullsized":"2024-05-10T03:53:39.264398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739331+0000","last_change":"2024-05-10T03:53:38.293020+0000","last_active":"2024-05-10T03:53:39.739331+0000","last_peered":"2024-05-10T03:53:39.739331+0000","last_clean":"2024-05-10T03:53:39.739331+0000","last_became_active":"2024-05-10T03:53:38.292705+0000","last_became_peered":"2024-05-10T03:53:38.292705+0000","last_unstale":"2024-05-10T03:53:39.739331+0000","last_undegraded":"2024-05-10T03:53:39.739331+0000","last_fullsized":"2024-05-10T03:53:39.739331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739887+0000","last_change":"2024-05-10T03:53:38.284864+0000","last_active":"2024-05-10T03:53:39.739887+0000","last_peered":"2024-05-10T03:53:39.739887+0000","last_clean":"2024-05-10T03:53:39.739887+0000","last_became_active":"2024-05-10T03:53:38.284218+0000","last_became_peered":"2024-05-10T03:53:38.284218+0000","last_unstale":"2024-05-10T03:53:39.739887+0000","last_undegraded":"2024-05-10T03:53:39.739887+0000","last_fullsized":"2024-05-10T03:53:39.739887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739948+0000","last_change":"2024-05-10T03:53:38.287775+0000","last_active":"2024-05-10T03:53:39.739948+0000","last_peered":"2024-05-10T03:53:39.739948+0000","last_clean":"2024-05-10T03:53:39.739948+0000","last_became_active":"2024-05-10T03:53:38.287415+0000","last_became_peered":"2024-05-10T03:53:38.287415+0000","last_unstale":"2024-05-10T03:53:39.739948+0000","last_undegraded":"2024-05-10T03:53:39.739948+0000","last_fullsized":"2024-05-10T03:53:39.739948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282193+0000","last_change":"2024-05-10T03:53:38.284657+0000","last_active":"2024-05-10T03:53:39.282193+0000","last_peered":"2024-05-10T03:53:39.282193+0000","last_clean":"2024-05-10T03:53:39.282193+0000","last_became_active":"2024-05-10T03:53:38.284355+0000","last_became_peered":"2024-05-10T03:53:38.284355+0000","last_unstale":"2024-05-10T03:53:39.282193+0000","last_undegraded":"2024-05-10T03:53:39.282193+0000","last_fullsized":"2024-05-10T03:53:39.282193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281859+0000","last_change":"2024-05-10T03:53:38.284078+0000","last_active":"2024-05-10T03:53:39.281859+0000","last_peered":"2024-05-10T03:53:39.281859+0000","last_clean":"2024-05-10T03:53:39.281859+0000","last_became_active":"2024-05-10T03:53:38.283536+0000","last_became_peered":"2024-05-10T03:53:38.283536+0000","last_unstale":"2024-05-10T03:53:39.281859+0000","last_undegraded":"2024-05-10T03:53:39.281859+0000","last_fullsized":"2024-05-10T03:53:39.281859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265420+0000","last_change":"2024-05-10T03:53:38.283440+0000","last_active":"2024-05-10T03:53:39.265420+0000","last_peered":"2024-05-10T03:53:39.265420+0000","last_clean":"2024-05-10T03:53:39.265420+0000","last_became_active":"2024-05-10T03:53:38.283164+0000","last_became_peered":"2024-05-10T03:53:38.283164+0000","last_unstale":"2024-05-10T03:53:39.265420+0000","last_undegraded":"2024-05-10T03:53:39.265420+0000","last_fullsized":"2024-05-10T03:53:39.265420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:06.608444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740425+0000","last_change":"2024-05-10T03:53:38.285762+0000","last_active":"2024-05-10T03:53:39.740425+0000","last_peered":"2024-05-10T03:53:39.740425+0000","last_clean":"2024-05-10T03:53:39.740425+0000","last_became_active":"2024-05-10T03:53:38.285417+0000","last_became_peered":"2024-05-10T03:53:38.285417+0000","last_unstale":"2024-05-10T03:53:39.740425+0000","last_undegraded":"2024-05-10T03:53:39.740425+0000","last_fullsized":"2024-05-10T03:53:39.740425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739884+0000","last_change":"2024-05-10T03:53:38.272933+0000","last_active":"2024-05-10T03:53:39.739884+0000","last_peered":"2024-05-10T03:53:39.739884+0000","last_clean":"2024-05-10T03:53:39.739884+0000","last_became_active":"2024-05-10T03:53:38.272640+0000","last_became_peered":"2024-05-10T03:53:38.272640+0000","last_unstale":"2024-05-10T03:53:39.739884+0000","last_undegraded":"2024-05-10T03:53:39.739884+0000","last_fullsized":"2024-05-10T03:53:39.739884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265166+0000","last_change":"2024-05-10T03:53:38.282326+0000","last_active":"2024-05-10T03:53:39.265166+0000","last_peered":"2024-05-10T03:53:39.265166+0000","last_clean":"2024-05-10T03:53:39.265166+0000","last_became_active":"2024-05-10T03:53:38.281972+0000","last_became_peered":"2024-05-10T03:53:38.281972+0000","last_unstale":"2024-05-10T03:53:39.265166+0000","last_undegraded":"2024-05-10T03:53:39.265166+0000","last_fullsized":"2024-05-10T03:53:39.265166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263803+0000","last_change":"2024-05-10T03:53:38.273240+0000","last_active":"2024-05-10T03:53:39.263803+0000","last_peered":"2024-05-10T03:53:39.263803+0000","last_clean":"2024-05-10T03:53:39.263803+0000","last_became_active":"2024-05-10T03:53:38.272959+0000","last_became_peered":"2024-05-10T03:53:38.272959+0000","last_unstale":"2024-05-10T03:53:39.263803+0000","last_undegraded":"2024-05-10T03:53:39.263803+0000","last_fullsized":"2024-05-10T03:53:39.263803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264807+0000","last_change":"2024-05-10T03:53:38.279725+0000","last_active":"2024-05-10T03:53:39.264807+0000","last_peered":"2024-05-10T03:53:39.264807+0000","last_clean":"2024-05-10T03:53:39.264807+0000","last_became_active":"2024-05-10T03:53:38.279431+0000","last_became_peered":"2024-05-10T03:53:38.279431+0000","last_unstale":"2024-05-10T03:53:39.264807+0000","last_undegraded":"2024-05-10T03:53:39.264807+0000","last_fullsized":"2024-05-10T03:53:39.264807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739515+0000","last_change":"2024-05-10T03:53:38.285220+0000","last_active":"2024-05-10T03:53:39.739515+0000","last_peered":"2024-05-10T03:53:39.739515+0000","last_clean":"2024-05-10T03:53:39.739515+0000","last_became_active":"2024-05-10T03:53:38.284921+0000","last_became_peered":"2024-05-10T03:53:38.284921+0000","last_unstale":"2024-05-10T03:53:39.739515+0000","last_undegraded":"2024-05-10T03:53:39.739515+0000","last_fullsized":"2024-05-10T03:53:39.739515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739873+0000","last_change":"2024-05-10T03:53:38.294490+0000","last_active":"2024-05-10T03:53:39.739873+0000","last_peered":"2024-05-10T03:53:39.739873+0000","last_clean":"2024-05-10T03:53:39.739873+0000","last_became_active":"2024-05-10T03:53:38.294235+0000","last_became_peered":"2024-05-10T03:53:38.294235+0000","last_unstale":"2024-05-10T03:53:39.739873+0000","last_undegraded":"2024-05-10T03:53:39.739873+0000","last_fullsized":"2024-05-10T03:53:39.739873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282104+0000","last_change":"2024-05-10T03:53:38.283315+0000","last_active":"2024-05-10T03:53:39.282104+0000","last_peered":"2024-05-10T03:53:39.282104+0000","last_clean":"2024-05-10T03:53:39.282104+0000","last_became_active":"2024-05-10T03:53:38.283022+0000","last_became_peered":"2024-05-10T03:53:38.283022+0000","last_unstale":"2024-05-10T03:53:39.282104+0000","last_undegraded":"2024-05-10T03:53:39.282104+0000","last_fullsized":"2024-05-10T03:53:39.282104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740216+0000","last_change":"2024-05-10T03:53:38.272217+0000","last_active":"2024-05-10T03:53:39.740216+0000","last_peered":"2024-05-10T03:53:39.740216+0000","last_clean":"2024-05-10T03:53:39.740216+0000","last_became_active":"2024-05-10T03:53:38.271877+0000","last_became_peered":"2024-05-10T03:53:38.271877+0000","last_unstale":"2024-05-10T03:53:39.740216+0000","last_undegraded":"2024-05-10T03:53:39.740216+0000","last_fullsized":"2024-05-10T03:53:39.740216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263880+0000","last_change":"2024-05-10T03:53:38.277088+0000","last_active":"2024-05-10T03:53:39.263880+0000","last_peered":"2024-05-10T03:53:39.263880+0000","last_clean":"2024-05-10T03:53:39.263880+0000","last_became_active":"2024-05-10T03:53:38.276824+0000","last_became_peered":"2024-05-10T03:53:38.276824+0000","last_unstale":"2024-05-10T03:53:39.263880+0000","last_undegraded":"2024-05-10T03:53:39.263880+0000","last_fullsized":"2024-05-10T03:53:39.263880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739566+0000","last_change":"2024-05-10T03:53:38.288727+0000","last_active":"2024-05-10T03:53:39.739566+0000","last_peered":"2024-05-10T03:53:39.739566+0000","last_clean":"2024-05-10T03:53:39.739566+0000","last_became_active":"2024-05-10T03:53:38.288432+0000","last_became_peered":"2024-05-10T03:53:38.288432+0000","last_unstale":"2024-05-10T03:53:39.739566+0000","last_undegraded":"2024-05-10T03:53:39.739566+0000","last_fullsized":"2024-05-10T03:53:39.739566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263999+0000","last_change":"2024-05-10T03:53:38.280010+0000","last_active":"2024-05-10T03:53:39.263999+0000","last_peered":"2024-05-10T03:53:39.263999+0000","last_clean":"2024-05-10T03:53:39.263999+0000","last_became_active":"2024-05-10T03:53:38.279685+0000","last_became_peered":"2024-05-10T03:53:38.279685+0000","last_unstale":"2024-05-10T03:53:39.263999+0000","last_undegraded":"2024-05-10T03:53:39.263999+0000","last_fullsized":"2024-05-10T03:53:39.263999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740768+0000","last_change":"2024-05-10T03:53:38.289402+0000","last_active":"2024-05-10T03:53:39.740768+0000","last_peered":"2024-05-10T03:53:39.740768+0000","last_clean":"2024-05-10T03:53:39.740768+0000","last_became_active":"2024-05-10T03:53:38.289056+0000","last_became_peered":"2024-05-10T03:53:38.289056+0000","last_unstale":"2024-05-10T03:53:39.740768+0000","last_undegraded":"2024-05-10T03:53:39.740768+0000","last_fullsized":"2024-05-10T03:53:39.740768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282219+0000","last_change":"2024-05-10T03:53:38.285946+0000","last_active":"2024-05-10T03:53:39.282219+0000","last_peered":"2024-05-10T03:53:39.282219+0000","last_clean":"2024-05-10T03:53:39.282219+0000","last_became_active":"2024-05-10T03:53:38.285673+0000","last_became_peered":"2024-05-10T03:53:38.285673+0000","last_unstale":"2024-05-10T03:53:39.282219+0000","last_undegraded":"2024-05-10T03:53:39.282219+0000","last_fullsized":"2024-05-10T03:53:39.282219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265431+0000","last_change":"2024-05-10T03:53:38.284555+0000","last_active":"2024-05-10T03:53:39.265431+0000","last_peered":"2024-05-10T03:53:39.265431+0000","last_clean":"2024-05-10T03:53:39.265431+0000","last_became_active":"2024-05-10T03:53:38.284271+0000","last_became_peered":"2024-05-10T03:53:38.284271+0000","last_unstale":"2024-05-10T03:53:39.265431+0000","last_undegraded":"2024-05-10T03:53:39.265431+0000","last_fullsized":"2024-05-10T03:53:39.265431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740719+0000","last_change":"2024-05-10T03:53:38.287638+0000","last_active":"2024-05-10T03:53:39.740719+0000","last_peered":"2024-05-10T03:53:39.740719+0000","last_clean":"2024-05-10T03:53:39.740719+0000","last_became_active":"2024-05-10T03:53:38.287378+0000","last_became_peered":"2024-05-10T03:53:38.287378+0000","last_unstale":"2024-05-10T03:53:39.740719+0000","last_undegraded":"2024-05-10T03:53:39.740719+0000","last_fullsized":"2024-05-10T03:53:39.740719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740296+0000","last_change":"2024-05-10T03:53:38.285862+0000","last_active":"2024-05-10T03:53:39.740296+0000","last_peered":"2024-05-10T03:53:39.740296+0000","last_clean":"2024-05-10T03:53:39.740296+0000","last_became_active":"2024-05-10T03:53:38.285480+0000","last_became_peered":"2024-05-10T03:53:38.285480+0000","last_unstale":"2024-05-10T03:53:39.740296+0000","last_undegraded":"2024-05-10T03:53:39.740296+0000","last_fullsized":"2024-05-10T03:53:39.740296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264048+0000","last_change":"2024-05-10T03:53:38.288261+0000","last_active":"2024-05-10T03:53:39.264048+0000","last_peered":"2024-05-10T03:53:39.264048+0000","last_clean":"2024-05-10T03:53:39.264048+0000","last_became_active":"2024-05-10T03:53:38.287960+0000","last_became_peered":"2024-05-10T03:53:38.287960+0000","last_unstale":"2024-05-10T03:53:39.264048+0000","last_undegraded":"2024-05-10T03:53:39.264048+0000","last_fullsized":"2024-05-10T03:53:39.264048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739269+0000","last_change":"2024-05-10T03:53:38.281223+0000","last_active":"2024-05-10T03:53:39.739269+0000","last_peered":"2024-05-10T03:53:39.739269+0000","last_clean":"2024-05-10T03:53:39.739269+0000","last_became_active":"2024-05-10T03:53:38.280925+0000","last_became_peered":"2024-05-10T03:53:38.280925+0000","last_unstale":"2024-05-10T03:53:39.739269+0000","last_undegraded":"2024-05-10T03:53:39.739269+0000","last_fullsized":"2024-05-10T03:53:39.739269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281698+0000","last_change":"2024-05-10T03:53:38.281574+0000","last_active":"2024-05-10T03:53:39.281698+0000","last_peered":"2024-05-10T03:53:39.281698+0000","last_clean":"2024-05-10T03:53:39.281698+0000","last_became_active":"2024-05-10T03:53:38.281248+0000","last_became_peered":"2024-05-10T03:53:38.281248+0000","last_unstale":"2024-05-10T03:53:39.281698+0000","last_undegraded":"2024-05-10T03:53:39.281698+0000","last_fullsized":"2024-05-10T03:53:39.281698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265201+0000","last_change":"2024-05-10T03:53:38.286690+0000","last_active":"2024-05-10T03:53:39.265201+0000","last_peered":"2024-05-10T03:53:39.265201+0000","last_clean":"2024-05-10T03:53:39.265201+0000","last_became_active":"2024-05-10T03:53:38.286328+0000","last_became_peered":"2024-05-10T03:53:38.286328+0000","last_unstale":"2024-05-10T03:53:39.265201+0000","last_undegraded":"2024-05-10T03:53:39.265201+0000","last_fullsized":"2024-05-10T03:53:39.265201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:54.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740539+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:39.740539+0000","last_peered":"2024-05-10T03:53:39.740539+0000","last_clean":"2024-05-10T03:53:39.740539+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:39.740539+0000","last_undegraded":"2024-05-10T03:53:39.740539+0000","last_fullsized":"2024-05-10T03:53:39.740539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740368+0000","last_change":"2024-05-10T03:53:38.287761+0000","last_active":"2024-05-10T03:53:39.740368+0000","last_peered":"2024-05-10T03:53:39.740368+0000","last_clean":"2024-05-10T03:53:39.740368+0000","last_became_active":"2024-05-10T03:53:38.286885+0000","last_became_peered":"2024-05-10T03:53:38.286885+0000","last_unstale":"2024-05-10T03:53:39.740368+0000","last_undegraded":"2024-05-10T03:53:39.740368+0000","last_fullsized":"2024-05-10T03:53:39.740368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281751+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:39.281751+0000","last_peered":"2024-05-10T03:53:39.281751+0000","last_clean":"2024-05-10T03:53:39.281751+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:39.281751+0000","last_undegraded":"2024-05-10T03:53:39.281751+0000","last_fullsized":"2024-05-10T03:53:39.281751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739717+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:39.739717+0000","last_peered":"2024-05-10T03:53:39.739717+0000","last_clean":"2024-05-10T03:53:39.739717+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:39.739717+0000","last_undegraded":"2024-05-10T03:53:39.739717+0000","last_fullsized":"2024-05-10T03:53:39.739717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740040+0000","last_change":"2024-05-10T03:53:38.290104+0000","last_active":"2024-05-10T03:53:39.740040+0000","last_peered":"2024-05-10T03:53:39.740040+0000","last_clean":"2024-05-10T03:53:39.740040+0000","last_became_active":"2024-05-10T03:53:38.289798+0000","last_became_peered":"2024-05-10T03:53:38.289798+0000","last_unstale":"2024-05-10T03:53:39.740040+0000","last_undegraded":"2024-05-10T03:53:39.740040+0000","last_fullsized":"2024-05-10T03:53:39.740040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264116+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:39.264116+0000","last_peered":"2024-05-10T03:53:39.264116+0000","last_clean":"2024-05-10T03:53:39.264116+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:39.264116+0000","last_undegraded":"2024-05-10T03:53:39.264116+0000","last_fullsized":"2024-05-10T03:53:39.264116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265151+0000","last_change":"2024-05-10T03:53:38.286333+0000","last_active":"2024-05-10T03:53:39.265151+0000","last_peered":"2024-05-10T03:53:39.265151+0000","last_clean":"2024-05-10T03:53:39.265151+0000","last_became_active":"2024-05-10T03:53:38.284982+0000","last_became_peered":"2024-05-10T03:53:38.284982+0000","last_unstale":"2024-05-10T03:53:39.265151+0000","last_undegraded":"2024-05-10T03:53:39.265151+0000","last_fullsized":"2024-05-10T03:53:39.265151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282035+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:39.282035+0000","last_peered":"2024-05-10T03:53:39.282035+0000","last_clean":"2024-05-10T03:53:39.282035+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:39.282035+0000","last_undegraded":"2024-05-10T03:53:39.282035+0000","last_fullsized":"2024-05-10T03:53:39.282035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264506+0000","last_change":"2024-05-10T03:53:38.282479+0000","last_active":"2024-05-10T03:53:39.264506+0000","last_peered":"2024-05-10T03:53:39.264506+0000","last_clean":"2024-05-10T03:53:39.264506+0000","last_became_active":"2024-05-10T03:53:38.278644+0000","last_became_peered":"2024-05-10T03:53:38.278644+0000","last_unstale":"2024-05-10T03:53:39.264506+0000","last_undegraded":"2024-05-10T03:53:39.264506+0000","last_fullsized":"2024-05-10T03:53:39.264506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264533+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:39.264533+0000","last_peered":"2024-05-10T03:53:39.264533+0000","last_clean":"2024-05-10T03:53:39.264533+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:39.264533+0000","last_undegraded":"2024-05-10T03:53:39.264533+0000","last_fullsized":"2024-05-10T03:53:39.264533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740124+0000","last_change":"2024-05-10T03:53:38.280103+0000","last_active":"2024-05-10T03:53:39.740124+0000","last_peered":"2024-05-10T03:53:39.740124+0000","last_clean":"2024-05-10T03:53:39.740124+0000","last_became_active":"2024-05-10T03:53:38.279821+0000","last_became_peered":"2024-05-10T03:53:38.279821+0000","last_unstale":"2024-05-10T03:53:39.740124+0000","last_undegraded":"2024-05-10T03:53:39.740124+0000","last_fullsized":"2024-05-10T03:53:39.740124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265414+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:39.265414+0000","last_peered":"2024-05-10T03:53:39.265414+0000","last_clean":"2024-05-10T03:53:39.265414+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:39.265414+0000","last_undegraded":"2024-05-10T03:53:39.265414+0000","last_fullsized":"2024-05-10T03:53:39.265414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265514+0000","last_change":"2024-05-10T03:53:38.281500+0000","last_active":"2024-05-10T03:53:39.265514+0000","last_peered":"2024-05-10T03:53:39.265514+0000","last_clean":"2024-05-10T03:53:39.265514+0000","last_became_active":"2024-05-10T03:53:38.281173+0000","last_became_peered":"2024-05-10T03:53:38.281173+0000","last_unstale":"2024-05-10T03:53:39.265514+0000","last_undegraded":"2024-05-10T03:53:39.265514+0000","last_fullsized":"2024-05-10T03:53:39.265514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282038+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:39.282038+0000","last_peered":"2024-05-10T03:53:39.282038+0000","last_clean":"2024-05-10T03:53:39.282038+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:39.282038+0000","last_undegraded":"2024-05-10T03:53:39.282038+0000","last_fullsized":"2024-05-10T03:53:39.282038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739639+0000","last_change":"2024-05-10T03:53:38.290859+0000","last_active":"2024-05-10T03:53:39.739639+0000","last_peered":"2024-05-10T03:53:39.739639+0000","last_clean":"2024-05-10T03:53:39.739639+0000","last_became_active":"2024-05-10T03:53:38.290575+0000","last_became_peered":"2024-05-10T03:53:38.290575+0000","last_unstale":"2024-05-10T03:53:39.739639+0000","last_undegraded":"2024-05-10T03:53:39.739639+0000","last_fullsized":"2024-05-10T03:53:39.739639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740395+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:39.740395+0000","last_peered":"2024-05-10T03:53:39.740395+0000","last_clean":"2024-05-10T03:53:39.740395+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:39.740395+0000","last_undegraded":"2024-05-10T03:53:39.740395+0000","last_fullsized":"2024-05-10T03:53:39.740395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739992+0000","last_change":"2024-05-10T03:53:38.277962+0000","last_active":"2024-05-10T03:53:39.739992+0000","last_peered":"2024-05-10T03:53:39.739992+0000","last_clean":"2024-05-10T03:53:39.739992+0000","last_became_active":"2024-05-10T03:53:38.277601+0000","last_became_peered":"2024-05-10T03:53:38.277601+0000","last_unstale":"2024-05-10T03:53:39.739992+0000","last_undegraded":"2024-05-10T03:53:39.739992+0000","last_fullsized":"2024-05-10T03:53:39.739992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264170+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:39.264170+0000","last_peered":"2024-05-10T03:53:39.264170+0000","last_clean":"2024-05-10T03:53:39.264170+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:39.264170+0000","last_undegraded":"2024-05-10T03:53:39.264170+0000","last_fullsized":"2024-05-10T03:53:39.264170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739591+0000","last_change":"2024-05-10T03:53:38.289892+0000","last_active":"2024-05-10T03:53:39.739591+0000","last_peered":"2024-05-10T03:53:39.739591+0000","last_clean":"2024-05-10T03:53:39.739591+0000","last_became_active":"2024-05-10T03:53:38.289548+0000","last_became_peered":"2024-05-10T03:53:38.289548+0000","last_unstale":"2024-05-10T03:53:39.739591+0000","last_undegraded":"2024-05-10T03:53:39.739591+0000","last_fullsized":"2024-05-10T03:53:39.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281775+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:39.281775+0000","last_peered":"2024-05-10T03:53:39.281775+0000","last_clean":"2024-05-10T03:53:39.281775+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:39.281775+0000","last_undegraded":"2024-05-10T03:53:39.281775+0000","last_fullsized":"2024-05-10T03:53:39.281775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281702+0000","last_change":"2024-05-10T03:53:38.282182+0000","last_active":"2024-05-10T03:53:39.281702+0000","last_peered":"2024-05-10T03:53:39.281702+0000","last_clean":"2024-05-10T03:53:39.281702+0000","last_became_active":"2024-05-10T03:53:38.281876+0000","last_became_peered":"2024-05-10T03:53:38.281876+0000","last_unstale":"2024-05-10T03:53:39.281702+0000","last_undegraded":"2024-05-10T03:53:39.281702+0000","last_fullsized":"2024-05-10T03:53:39.281702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739297+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:39.739297+0000","last_peered":"2024-05-10T03:53:39.739297+0000","last_clean":"2024-05-10T03:53:39.739297+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:39.739297+0000","last_undegraded":"2024-05-10T03:53:39.739297+0000","last_fullsized":"2024-05-10T03:53:39.739297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739300+0000","last_change":"2024-05-10T03:53:38.286582+0000","last_active":"2024-05-10T03:53:39.739300+0000","last_peered":"2024-05-10T03:53:39.739300+0000","last_clean":"2024-05-10T03:53:39.739300+0000","last_became_active":"2024-05-10T03:53:38.286302+0000","last_became_peered":"2024-05-10T03:53:38.286302+0000","last_unstale":"2024-05-10T03:53:39.739300+0000","last_undegraded":"2024-05-10T03:53:39.739300+0000","last_fullsized":"2024-05-10T03:53:39.739300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265577+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:39.265577+0000","last_peered":"2024-05-10T03:53:39.265577+0000","last_clean":"2024-05-10T03:53:39.265577+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:39.265577+0000","last_undegraded":"2024-05-10T03:53:39.265577+0000","last_fullsized":"2024-05-10T03:53:39.265577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739847+0000","last_change":"2024-05-10T03:53:38.285319+0000","last_active":"2024-05-10T03:53:39.739847+0000","last_peered":"2024-05-10T03:53:39.739847+0000","last_clean":"2024-05-10T03:53:39.739847+0000","last_became_active":"2024-05-10T03:53:38.284885+0000","last_became_peered":"2024-05-10T03:53:38.284885+0000","last_unstale":"2024-05-10T03:53:39.739847+0000","last_undegraded":"2024-05-10T03:53:39.739847+0000","last_fullsized":"2024-05-10T03:53:39.739847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739629+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:39.739629+0000","last_peered":"2024-05-10T03:53:39.739629+0000","last_clean":"2024-05-10T03:53:39.739629+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:39.739629+0000","last_undegraded":"2024-05-10T03:53:39.739629+0000","last_fullsized":"2024-05-10T03:53:39.739629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740026+0000","last_change":"2024-05-10T03:53:38.289329+0000","last_active":"2024-05-10T03:53:39.740026+0000","last_peered":"2024-05-10T03:53:39.740026+0000","last_clean":"2024-05-10T03:53:39.740026+0000","last_became_active":"2024-05-10T03:53:38.288826+0000","last_became_peered":"2024-05-10T03:53:38.288826+0000","last_unstale":"2024-05-10T03:53:39.740026+0000","last_undegraded":"2024-05-10T03:53:39.740026+0000","last_fullsized":"2024-05-10T03:53:39.740026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:21.126895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265522+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:39.265522+0000","last_peered":"2024-05-10T03:53:39.265522+0000","last_clean":"2024-05-10T03:53:39.265522+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:39.265522+0000","last_undegraded":"2024-05-10T03:53:39.265522+0000","last_fullsized":"2024-05-10T03:53:39.265522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264802+0000","last_change":"2024-05-10T03:53:38.293738+0000","last_active":"2024-05-10T03:53:39.264802+0000","last_peered":"2024-05-10T03:53:39.264802+0000","last_clean":"2024-05-10T03:53:39.264802+0000","last_became_active":"2024-05-10T03:53:38.293306+0000","last_became_peered":"2024-05-10T03:53:38.293306+0000","last_unstale":"2024-05-10T03:53:39.264802+0000","last_undegraded":"2024-05-10T03:53:39.264802+0000","last_fullsized":"2024-05-10T03:53:39.264802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739497+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:39.739497+0000","last_peered":"2024-05-10T03:53:39.739497+0000","last_clean":"2024-05-10T03:53:39.739497+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:39.739497+0000","last_undegraded":"2024-05-10T03:53:39.739497+0000","last_fullsized":"2024-05-10T03:53:39.739497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739619+0000","last_change":"2024-05-10T03:53:38.285973+0000","last_active":"2024-05-10T03:53:39.739619+0000","last_peered":"2024-05-10T03:53:39.739619+0000","last_clean":"2024-05-10T03:53:39.739619+0000","last_became_active":"2024-05-10T03:53:38.285695+0000","last_became_peered":"2024-05-10T03:53:38.285695+0000","last_unstale":"2024-05-10T03:53:39.739619+0000","last_undegraded":"2024-05-10T03:53:39.739619+0000","last_fullsized":"2024-05-10T03:53:39.739619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739339+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:39.739339+0000","last_peered":"2024-05-10T03:53:39.739339+0000","last_clean":"2024-05-10T03:53:39.739339+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:39.739339+0000","last_undegraded":"2024-05-10T03:53:39.739339+0000","last_fullsized":"2024-05-10T03:53:39.739339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263868+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:39.263868+0000","last_peered":"2024-05-10T03:53:39.263868+0000","last_clean":"2024-05-10T03:53:39.263868+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:39.263868+0000","last_undegraded":"2024-05-10T03:53:39.263868+0000","last_fullsized":"2024-05-10T03:53:39.263868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739475+0000","last_change":"2024-05-10T03:53:38.289280+0000","last_active":"2024-05-10T03:53:39.739475+0000","last_peered":"2024-05-10T03:53:39.739475+0000","last_clean":"2024-05-10T03:53:39.739475+0000","last_became_active":"2024-05-10T03:53:38.288941+0000","last_became_peered":"2024-05-10T03:53:38.288941+0000","last_unstale":"2024-05-10T03:53:39.739475+0000","last_undegraded":"2024-05-10T03:53:39.739475+0000","last_fullsized":"2024-05-10T03:53:39.739475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739157+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:39.739157+0000","last_peered":"2024-05-10T03:53:39.739157+0000","last_clean":"2024-05-10T03:53:39.739157+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:39.739157+0000","last_undegraded":"2024-05-10T03:53:39.739157+0000","last_fullsized":"2024-05-10T03:53:39.739157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739532+0000","last_change":"2024-05-10T03:53:38.287044+0000","last_active":"2024-05-10T03:53:39.739532+0000","last_peered":"2024-05-10T03:53:39.739532+0000","last_clean":"2024-05-10T03:53:39.739532+0000","last_became_active":"2024-05-10T03:53:38.286731+0000","last_became_peered":"2024-05-10T03:53:38.286731+0000","last_unstale":"2024-05-10T03:53:39.739532+0000","last_undegraded":"2024-05-10T03:53:39.739532+0000","last_fullsized":"2024-05-10T03:53:39.739532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:05.026634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739381+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:39.739381+0000","last_peered":"2024-05-10T03:53:39.739381+0000","last_clean":"2024-05-10T03:53:39.739381+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:39.739381+0000","last_undegraded":"2024-05-10T03:53:39.739381+0000","last_fullsized":"2024-05-10T03:53:39.739381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265186+0000","last_change":"2024-05-10T03:53:38.273845+0000","last_active":"2024-05-10T03:53:39.265186+0000","last_peered":"2024-05-10T03:53:39.265186+0000","last_clean":"2024-05-10T03:53:39.265186+0000","last_became_active":"2024-05-10T03:53:38.273237+0000","last_became_peered":"2024-05-10T03:53:38.273237+0000","last_unstale":"2024-05-10T03:53:39.265186+0000","last_undegraded":"2024-05-10T03:53:39.265186+0000","last_fullsized":"2024-05-10T03:53:39.265186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264285+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:39.264285+0000","last_peered":"2024-05-10T03:53:39.264285+0000","last_clean":"2024-05-10T03:53:39.264285+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:39.264285+0000","last_undegraded":"2024-05-10T03:53:39.264285+0000","last_fullsized":"2024-05-10T03:53:39.264285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265435+0000","last_change":"2024-05-10T03:53:38.281466+0000","last_active":"2024-05-10T03:53:39.265435+0000","last_peered":"2024-05-10T03:53:39.265435+0000","last_clean":"2024-05-10T03:53:39.265435+0000","last_became_active":"2024-05-10T03:53:38.281104+0000","last_became_peered":"2024-05-10T03:53:38.281104+0000","last_unstale":"2024-05-10T03:53:39.265435+0000","last_undegraded":"2024-05-10T03:53:39.265435+0000","last_fullsized":"2024-05-10T03:53:39.265435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265302+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:39.265302+0000","last_peered":"2024-05-10T03:53:39.265302+0000","last_clean":"2024-05-10T03:53:39.265302+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:39.265302+0000","last_undegraded":"2024-05-10T03:53:39.265302+0000","last_fullsized":"2024-05-10T03:53:39.265302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264277+0000","last_change":"2024-05-10T03:53:38.287931+0000","last_active":"2024-05-10T03:53:39.264277+0000","last_peered":"2024-05-10T03:53:39.264277+0000","last_clean":"2024-05-10T03:53:39.264277+0000","last_became_active":"2024-05-10T03:53:38.287647+0000","last_became_peered":"2024-05-10T03:53:38.287647+0000","last_unstale":"2024-05-10T03:53:39.264277+0000","last_undegraded":"2024-05-10T03:53:39.264277+0000","last_fullsized":"2024-05-10T03:53:39.264277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739944+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:39.739944+0000","last_peered":"2024-05-10T03:53:39.739944+0000","last_clean":"2024-05-10T03:53:39.739944+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:39.739944+0000","last_undegraded":"2024-05-10T03:53:39.739944+0000","last_fullsized":"2024-05-10T03:53:39.739944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265284+0000","last_change":"2024-05-10T03:53:38.280342+0000","last_active":"2024-05-10T03:53:39.265284+0000","last_peered":"2024-05-10T03:53:39.265284+0000","last_clean":"2024-05-10T03:53:39.265284+0000","last_became_active":"2024-05-10T03:53:38.279318+0000","last_became_peered":"2024-05-10T03:53:38.279318+0000","last_unstale":"2024-05-10T03:53:39.265284+0000","last_undegraded":"2024-05-10T03:53:39.265284+0000","last_fullsized":"2024-05-10T03:53:39.265284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265488+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:39.265488+0000","last_peered":"2024-05-10T03:53:39.265488+0000","last_clean":"2024-05-10T03:53:39.265488+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:39.265488+0000","last_undegraded":"2024-05-10T03:53:39.265488+0000","last_fullsized":"2024-05-10T03:53:39.265488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740780+0000","last_change":"2024-05-10T03:53:38.290232+0000","last_active":"2024-05-10T03:53:39.740780+0000","last_peered":"2024-05-10T03:53:39.740780+0000","last_clean":"2024-05-10T03:53:39.740780+0000","last_became_active":"2024-05-10T03:53:38.289945+0000","last_became_peered":"2024-05-10T03:53:38.289945+0000","last_unstale":"2024-05-10T03:53:39.740780+0000","last_undegraded":"2024-05-10T03:53:39.740780+0000","last_fullsized":"2024-05-10T03:53:39.740780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282115+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:39.282115+0000","last_peered":"2024-05-10T03:53:39.282115+0000","last_clean":"2024-05-10T03:53:39.282115+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:39.282115+0000","last_undegraded":"2024-05-10T03:53:39.282115+0000","last_fullsized":"2024-05-10T03:53:39.282115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740024+0000","last_change":"2024-05-10T03:53:38.277345+0000","last_active":"2024-05-10T03:53:39.740024+0000","last_peered":"2024-05-10T03:53:39.740024+0000","last_clean":"2024-05-10T03:53:39.740024+0000","last_became_active":"2024-05-10T03:53:38.273372+0000","last_became_peered":"2024-05-10T03:53:38.273372+0000","last_unstale":"2024-05-10T03:53:39.740024+0000","last_undegraded":"2024-05-10T03:53:39.740024+0000","last_fullsized":"2024-05-10T03:53:39.740024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739148+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:39.739148+0000","last_peered":"2024-05-10T03:53:39.739148+0000","last_clean":"2024-05-10T03:53:39.739148+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:39.739148+0000","last_undegraded":"2024-05-10T03:53:39.739148+0000","last_fullsized":"2024-05-10T03:53:39.739148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265162+0000","last_change":"2024-05-10T03:53:38.271356+0000","last_active":"2024-05-10T03:53:39.265162+0000","last_peered":"2024-05-10T03:53:39.265162+0000","last_clean":"2024-05-10T03:53:39.265162+0000","last_became_active":"2024-05-10T03:53:38.271041+0000","last_became_peered":"2024-05-10T03:53:38.271041+0000","last_unstale":"2024-05-10T03:53:39.265162+0000","last_undegraded":"2024-05-10T03:53:39.265162+0000","last_fullsized":"2024-05-10T03:53:39.265162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:02.308236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265262+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:39.265262+0000","last_peered":"2024-05-10T03:53:39.265262+0000","last_clean":"2024-05-10T03:53:39.265262+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:39.265262+0000","last_undegraded":"2024-05-10T03:53:39.265262+0000","last_fullsized":"2024-05-10T03:53:39.265262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740183+0000","last_change":"2024-05-10T03:53:38.283634+0000","last_active":"2024-05-10T03:53:39.740183+0000","last_peered":"2024-05-10T03:53:39.740183+0000","last_clean":"2024-05-10T03:53:39.740183+0000","last_became_active":"2024-05-10T03:53:38.283346+0000","last_became_peered":"2024-05-10T03:53:38.283346+0000","last_unstale":"2024-05-10T03:53:39.740183+0000","last_undegraded":"2024-05-10T03:53:39.740183+0000","last_fullsized":"2024-05-10T03:53:39.740183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265349+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:39.265349+0000","last_peered":"2024-05-10T03:53:39.265349+0000","last_clean":"2024-05-10T03:53:39.265349+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:39.265349+0000","last_undegraded":"2024-05-10T03:53:39.265349+0000","last_fullsized":"2024-05-10T03:53:39.265349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740534+0000","last_change":"2024-05-10T03:53:38.283122+0000","last_active":"2024-05-10T03:53:39.740534+0000","last_peered":"2024-05-10T03:53:39.740534+0000","last_clean":"2024-05-10T03:53:39.740534+0000","last_became_active":"2024-05-10T03:53:38.282829+0000","last_became_peered":"2024-05-10T03:53:38.282829+0000","last_unstale":"2024-05-10T03:53:39.740534+0000","last_undegraded":"2024-05-10T03:53:39.740534+0000","last_fullsized":"2024-05-10T03:53:39.740534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739663+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:39.739663+0000","last_peered":"2024-05-10T03:53:39.739663+0000","last_clean":"2024-05-10T03:53:39.739663+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:39.739663+0000","last_undegraded":"2024-05-10T03:53:39.739663+0000","last_fullsized":"2024-05-10T03:53:39.739663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282013+0000","last_change":"2024-05-10T03:53:38.287504+0000","last_active":"2024-05-10T03:53:39.282013+0000","last_peered":"2024-05-10T03:53:39.282013+0000","last_clean":"2024-05-10T03:53:39.282013+0000","last_became_active":"2024-05-10T03:53:38.287245+0000","last_became_peered":"2024-05-10T03:53:38.287245+0000","last_unstale":"2024-05-10T03:53:39.282013+0000","last_undegraded":"2024-05-10T03:53:39.282013+0000","last_fullsized":"2024-05-10T03:53:39.282013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264216+0000","last_change":"2024-05-10T03:53:38.282467+0000","last_active":"2024-05-10T03:53:39.264216+0000","last_peered":"2024-05-10T03:53:39.264216+0000","last_clean":"2024-05-10T03:53:39.264216+0000","last_became_active":"2024-05-10T03:53:38.282177+0000","last_became_peered":"2024-05-10T03:53:38.282177+0000","last_unstale":"2024-05-10T03:53:39.264216+0000","last_undegraded":"2024-05-10T03:53:39.264216+0000","last_fullsized":"2024-05-10T03:53:39.264216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739507+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:39.739507+0000","last_peered":"2024-05-10T03:53:39.739507+0000","last_clean":"2024-05-10T03:53:39.739507+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:39.739507+0000","last_undegraded":"2024-05-10T03:53:39.739507+0000","last_fullsized":"2024-05-10T03:53:39.739507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264617+0000","last_change":"2024-05-10T03:53:38.287053+0000","last_active":"2024-05-10T03:53:39.264617+0000","last_peered":"2024-05-10T03:53:39.264617+0000","last_clean":"2024-05-10T03:53:39.264617+0000","last_became_active":"2024-05-10T03:53:38.286767+0000","last_became_peered":"2024-05-10T03:53:38.286767+0000","last_unstale":"2024-05-10T03:53:39.264617+0000","last_undegraded":"2024-05-10T03:53:39.264617+0000","last_fullsized":"2024-05-10T03:53:39.264617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739812+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:39.739812+0000","last_peered":"2024-05-10T03:53:39.739812+0000","last_clean":"2024-05-10T03:53:39.739812+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:39.739812+0000","last_undegraded":"2024-05-10T03:53:39.739812+0000","last_fullsized":"2024-05-10T03:53:39.739812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740006+0000","last_change":"2024-05-10T03:53:38.281054+0000","last_active":"2024-05-10T03:53:39.740006+0000","last_peered":"2024-05-10T03:53:39.740006+0000","last_clean":"2024-05-10T03:53:39.740006+0000","last_became_active":"2024-05-10T03:53:38.280762+0000","last_became_peered":"2024-05-10T03:53:38.280762+0000","last_unstale":"2024-05-10T03:53:39.740006+0000","last_undegraded":"2024-05-10T03:53:39.740006+0000","last_fullsized":"2024-05-10T03:53:39.740006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740638+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:39.740638+0000","last_peered":"2024-05-10T03:53:39.740638+0000","last_clean":"2024-05-10T03:53:39.740638+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:39.740638+0000","last_undegraded":"2024-05-10T03:53:39.740638+0000","last_fullsized":"2024-05-10T03:53:39.740638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740557+0000","last_change":"2024-05-10T03:53:38.285034+0000","last_active":"2024-05-10T03:53:39.740557+0000","last_peered":"2024-05-10T03:53:39.740557+0000","last_clean":"2024-05-10T03:53:39.740557+0000","last_became_active":"2024-05-10T03:53:38.284756+0000","last_became_peered":"2024-05-10T03:53:38.284756+0000","last_unstale":"2024-05-10T03:53:39.740557+0000","last_undegraded":"2024-05-10T03:53:39.740557+0000","last_fullsized":"2024-05-10T03:53:39.740557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740208+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:39.740208+0000","last_peered":"2024-05-10T03:53:39.740208+0000","last_clean":"2024-05-10T03:53:39.740208+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:39.740208+0000","last_undegraded":"2024-05-10T03:53:39.740208+0000","last_fullsized":"2024-05-10T03:53:39.740208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":802816,"data_stored":661498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":70708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":811008,"data_stored":661554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:46.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:47.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.008+0000 7f82b9ac4640 1 Processor -- start 2024-05-10T03:53:47.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.008+0000 7f82b9ac4640 1 -- start start 2024-05-10T03:53:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b9ac4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82b415c5d0 0x7f82b415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b9ac4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82b415d0c0 con 0x7f82b40d0430 2024-05-10T03:53:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b9ac4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82b415d3a0 con 0x7f82b413f0b0 2024-05-10T03:53:47.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b9ac4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f82b413f490 con 0x7f82b415c5d0 2024-05-10T03:53:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82b415c5d0 0x7f82b415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82b415c5d0 0x7f82b415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56626/0 (socket says 172.21.15.55:56626) 2024-05-10T03:53:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.009+0000 7f82b2ffd640 1 -- 172.21.15.55:0/231327234 learned_addr learned my addr 172.21.15.55:0/231327234 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.010+0000 7f82b2ffd640 1 -- 172.21.15.55:0/231327234 >> v1:172.21.15.64:6789/0 conn(0x7f82b413f0b0 legacy=0x7f82b413f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.010+0000 7f82b2ffd640 1 -- 172.21.15.55:0/231327234 >> v1:172.21.15.55:6789/0 conn(0x7f82b40d0430 legacy=0x7f82b4073c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.010+0000 7f82b2ffd640 1 -- 172.21.15.55:0/231327234 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b40cfc30 con 0x7f82b415c5d0 2024-05-10T03:53:47.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.010+0000 7f82b2ffd640 1 --2- 172.21.15.55:0/231327234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b415c5d0 0x7f82b415ca80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82b413f610 tx=0x7f82a802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4588347dcc3cb2b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b27fc640 1 -- 172.21.15.55:0/231327234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8037070 con 0x7f82b415c5d0 2024-05-10T03:53:47.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b27fc640 1 -- 172.21.15.55:0/231327234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a8032640 con 0x7f82b415c5d0 2024-05-10T03:53:47.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b27fc640 1 -- 172.21.15.55:0/231327234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8032a10 con 0x7f82b415c5d0 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 -- 172.21.15.55:0/231327234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b415c5d0 msgr2=0x7f82b415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/231327234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b415c5d0 0x7f82b415ca80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82b413f610 tx=0x7f82a802a2e0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 -- 172.21.15.55:0/231327234 shutdown_connections 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/231327234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b415c5d0 0x7f82b415ca80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 -- 172.21.15.55:0/231327234 >> 172.21.15.55:0/231327234 conn(0x7f82b40b2cc0 msgr2=0x7f82b40b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 -- 172.21.15.55:0/231327234 shutdown_connections 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.011+0000 7f82b9ac4640 1 -- 172.21.15.55:0/231327234 wait complete. 2024-05-10T03:53:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.012+0000 7f82b9ac4640 1 Processor -- start 2024-05-10T03:53:47.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 -- start start 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 0x7f82b413b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b413f0b0 0x7f82b414a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b415c5d0 0x7f82b414aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f82b40727b0 con 0x7f82b40d0430 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82b40cffa0 con 0x7f82b415c5d0 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.013+0000 7f82b9ac4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f82b413fe50 con 0x7f82b413f0b0 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 0x7f82b413b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 0x7f82b413b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56632/0 (socket says 172.21.15.55:56632) 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 -- 172.21.15.55:0/813054376 learned_addr learned my addr 172.21.15.55:0/813054376 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b3fff640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b415c5d0 0x7f82b414aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 -- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b413f0b0 msgr2=0x7f82b414a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b413f0b0 0x7f82b414a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 -- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b415c5d0 msgr2=0x7f82b414aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b415c5d0 0x7f82b414aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 -- 172.21.15.55:0/813054376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b41e6000 con 0x7f82b40d0430 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b3fff640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b415c5d0 0x7f82b414aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b37fe640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 0x7f82b413b500 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c530 tx=0x7f82a400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a40052d0 con 0x7f82b40d0430 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a4005470 con 0x7f82b40d0430 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a4012870 con 0x7f82b40d0430 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.014+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b41e62e0 con 0x7f82b40d0430 2024-05-10T03:53:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.015+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b413ded0 con 0x7f82b40d0430 2024-05-10T03:53:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.016+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b4050820 con 0x7f82b40d0430 2024-05-10T03:53:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.016+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82a4012a10 con 0x7f82b40d0430 2024-05-10T03:53:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.017+0000 7f829bfff640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82a0076300 0x7f82a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.017+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82a40971c0 con 0x7f82b40d0430 2024-05-10T03:53:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.017+0000 7f82b2ffd640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82a0076300 0x7f82a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.017+0000 7f82b2ffd640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82a0076300 0x7f82a00787c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82a8034000 tx=0x7f82a802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.021+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82a4060b20 con 0x7f82b40d0430 2024-05-10T03:53:47.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.208+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82b4072390 con 0x7f82a0076300 2024-05-10T03:53:47.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.214+0000 7f829bfff640 1 -- 172.21.15.55:0/813054376 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f82b4072390 con 0x7f82a0076300 2024-05-10T03:53:47.220 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:47.221 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:47.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82a0076300 msgr2=0x7f82a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82a0076300 0x7f82a00787c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82a8034000 tx=0x7f82a802c000 comp rx=0 tx=0).stop 2024-05-10T03:53:47.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 msgr2=0x7f82b413b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 0x7f82b413b500 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82a400c530 tx=0x7f82a400c9f0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 shutdown_connections 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b415c5d0 0x7f82b414aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b413f0b0 0x7f82b414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82a0076300 0x7f82a00787c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 --2- 172.21.15.55:0/813054376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b40d0430 0x7f82b413b500 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 >> 172.21.15.55:0/813054376 conn(0x7f82b40b2cc0 msgr2=0x7f82b40b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 shutdown_connections 2024-05-10T03:53:47.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.217+0000 7f82b9ac4640 1 -- 172.21.15.55:0/813054376 wait complete. 2024-05-10T03:53:47.231 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-10T03:53:45.783143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236136,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738584,"statfs":{"total":773094113280,"available":772852310016,"internally_reserved":0,"allocated":2891776,"data_stored":1749940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.522917"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739883+0000","last_change":"2024-05-10T03:53:38.288661+0000","last_active":"2024-05-10T03:53:39.739883+0000","last_peered":"2024-05-10T03:53:39.739883+0000","last_clean":"2024-05-10T03:53:39.739883+0000","last_became_active":"2024-05-10T03:53:38.287374+0000","last_became_peered":"2024-05-10T03:53:38.287374+0000","last_unstale":"2024-05-10T03:53:39.739883+0000","last_undegraded":"2024-05-10T03:53:39.739883+0000","last_fullsized":"2024-05-10T03:53:39.739883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265472+0000","last_change":"2024-05-10T03:53:38.272836+0000","last_active":"2024-05-10T03:53:39.265472+0000","last_peered":"2024-05-10T03:53:39.265472+0000","last_clean":"2024-05-10T03:53:39.265472+0000","last_became_active":"2024-05-10T03:53:38.272458+0000","last_became_peered":"2024-05-10T03:53:38.272458+0000","last_unstale":"2024-05-10T03:53:39.265472+0000","last_undegraded":"2024-05-10T03:53:39.265472+0000","last_fullsized":"2024-05-10T03:53:39.265472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739779+0000","last_change":"2024-05-10T03:53:38.268359+0000","last_active":"2024-05-10T03:53:39.739779+0000","last_peered":"2024-05-10T03:53:39.739779+0000","last_clean":"2024-05-10T03:53:39.739779+0000","last_became_active":"2024-05-10T03:53:38.268051+0000","last_became_peered":"2024-05-10T03:53:38.268051+0000","last_unstale":"2024-05-10T03:53:39.739779+0000","last_undegraded":"2024-05-10T03:53:39.739779+0000","last_fullsized":"2024-05-10T03:53:39.739779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:48.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264426+0000","last_change":"2024-05-10T03:53:38.293481+0000","last_active":"2024-05-10T03:53:39.264426+0000","last_peered":"2024-05-10T03:53:39.264426+0000","last_clean":"2024-05-10T03:53:39.264426+0000","last_became_active":"2024-05-10T03:53:38.293159+0000","last_became_peered":"2024-05-10T03:53:38.293159+0000","last_unstale":"2024-05-10T03:53:39.264426+0000","last_undegraded":"2024-05-10T03:53:39.264426+0000","last_fullsized":"2024-05-10T03:53:39.264426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739524+0000","last_change":"2024-05-10T03:53:38.294420+0000","last_active":"2024-05-10T03:53:39.739524+0000","last_peered":"2024-05-10T03:53:39.739524+0000","last_clean":"2024-05-10T03:53:39.739524+0000","last_became_active":"2024-05-10T03:53:38.294120+0000","last_became_peered":"2024-05-10T03:53:38.294120+0000","last_unstale":"2024-05-10T03:53:39.739524+0000","last_undegraded":"2024-05-10T03:53:39.739524+0000","last_fullsized":"2024-05-10T03:53:39.739524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264398+0000","last_change":"2024-05-10T03:53:38.272472+0000","last_active":"2024-05-10T03:53:39.264398+0000","last_peered":"2024-05-10T03:53:39.264398+0000","last_clean":"2024-05-10T03:53:39.264398+0000","last_became_active":"2024-05-10T03:53:38.272160+0000","last_became_peered":"2024-05-10T03:53:38.272160+0000","last_unstale":"2024-05-10T03:53:39.264398+0000","last_undegraded":"2024-05-10T03:53:39.264398+0000","last_fullsized":"2024-05-10T03:53:39.264398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739331+0000","last_change":"2024-05-10T03:53:38.293020+0000","last_active":"2024-05-10T03:53:39.739331+0000","last_peered":"2024-05-10T03:53:39.739331+0000","last_clean":"2024-05-10T03:53:39.739331+0000","last_became_active":"2024-05-10T03:53:38.292705+0000","last_became_peered":"2024-05-10T03:53:38.292705+0000","last_unstale":"2024-05-10T03:53:39.739331+0000","last_undegraded":"2024-05-10T03:53:39.739331+0000","last_fullsized":"2024-05-10T03:53:39.739331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739887+0000","last_change":"2024-05-10T03:53:38.284864+0000","last_active":"2024-05-10T03:53:39.739887+0000","last_peered":"2024-05-10T03:53:39.739887+0000","last_clean":"2024-05-10T03:53:39.739887+0000","last_became_active":"2024-05-10T03:53:38.284218+0000","last_became_peered":"2024-05-10T03:53:38.284218+0000","last_unstale":"2024-05-10T03:53:39.739887+0000","last_undegraded":"2024-05-10T03:53:39.739887+0000","last_fullsized":"2024-05-10T03:53:39.739887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739948+0000","last_change":"2024-05-10T03:53:38.287775+0000","last_active":"2024-05-10T03:53:39.739948+0000","last_peered":"2024-05-10T03:53:39.739948+0000","last_clean":"2024-05-10T03:53:39.739948+0000","last_became_active":"2024-05-10T03:53:38.287415+0000","last_became_peered":"2024-05-10T03:53:38.287415+0000","last_unstale":"2024-05-10T03:53:39.739948+0000","last_undegraded":"2024-05-10T03:53:39.739948+0000","last_fullsized":"2024-05-10T03:53:39.739948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282193+0000","last_change":"2024-05-10T03:53:38.284657+0000","last_active":"2024-05-10T03:53:39.282193+0000","last_peered":"2024-05-10T03:53:39.282193+0000","last_clean":"2024-05-10T03:53:39.282193+0000","last_became_active":"2024-05-10T03:53:38.284355+0000","last_became_peered":"2024-05-10T03:53:38.284355+0000","last_unstale":"2024-05-10T03:53:39.282193+0000","last_undegraded":"2024-05-10T03:53:39.282193+0000","last_fullsized":"2024-05-10T03:53:39.282193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281859+0000","last_change":"2024-05-10T03:53:38.284078+0000","last_active":"2024-05-10T03:53:39.281859+0000","last_peered":"2024-05-10T03:53:39.281859+0000","last_clean":"2024-05-10T03:53:39.281859+0000","last_became_active":"2024-05-10T03:53:38.283536+0000","last_became_peered":"2024-05-10T03:53:38.283536+0000","last_unstale":"2024-05-10T03:53:39.281859+0000","last_undegraded":"2024-05-10T03:53:39.281859+0000","last_fullsized":"2024-05-10T03:53:39.281859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265420+0000","last_change":"2024-05-10T03:53:38.283440+0000","last_active":"2024-05-10T03:53:39.265420+0000","last_peered":"2024-05-10T03:53:39.265420+0000","last_clean":"2024-05-10T03:53:39.265420+0000","last_became_active":"2024-05-10T03:53:38.283164+0000","last_became_peered":"2024-05-10T03:53:38.283164+0000","last_unstale":"2024-05-10T03:53:39.265420+0000","last_undegraded":"2024-05-10T03:53:39.265420+0000","last_fullsized":"2024-05-10T03:53:39.265420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:06.608444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740425+0000","last_change":"2024-05-10T03:53:38.285762+0000","last_active":"2024-05-10T03:53:39.740425+0000","last_peered":"2024-05-10T03:53:39.740425+0000","last_clean":"2024-05-10T03:53:39.740425+0000","last_became_active":"2024-05-10T03:53:38.285417+0000","last_became_peered":"2024-05-10T03:53:38.285417+0000","last_unstale":"2024-05-10T03:53:39.740425+0000","last_undegraded":"2024-05-10T03:53:39.740425+0000","last_fullsized":"2024-05-10T03:53:39.740425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739884+0000","last_change":"2024-05-10T03:53:38.272933+0000","last_active":"2024-05-10T03:53:39.739884+0000","last_peered":"2024-05-10T03:53:39.739884+0000","last_clean":"2024-05-10T03:53:39.739884+0000","last_became_active":"2024-05-10T03:53:38.272640+0000","last_became_peered":"2024-05-10T03:53:38.272640+0000","last_unstale":"2024-05-10T03:53:39.739884+0000","last_undegraded":"2024-05-10T03:53:39.739884+0000","last_fullsized":"2024-05-10T03:53:39.739884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265166+0000","last_change":"2024-05-10T03:53:38.282326+0000","last_active":"2024-05-10T03:53:39.265166+0000","last_peered":"2024-05-10T03:53:39.265166+0000","last_clean":"2024-05-10T03:53:39.265166+0000","last_became_active":"2024-05-10T03:53:38.281972+0000","last_became_peered":"2024-05-10T03:53:38.281972+0000","last_unstale":"2024-05-10T03:53:39.265166+0000","last_undegraded":"2024-05-10T03:53:39.265166+0000","last_fullsized":"2024-05-10T03:53:39.265166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263803+0000","last_change":"2024-05-10T03:53:38.273240+0000","last_active":"2024-05-10T03:53:39.263803+0000","last_peered":"2024-05-10T03:53:39.263803+0000","last_clean":"2024-05-10T03:53:39.263803+0000","last_became_active":"2024-05-10T03:53:38.272959+0000","last_became_peered":"2024-05-10T03:53:38.272959+0000","last_unstale":"2024-05-10T03:53:39.263803+0000","last_undegraded":"2024-05-10T03:53:39.263803+0000","last_fullsized":"2024-05-10T03:53:39.263803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264807+0000","last_change":"2024-05-10T03:53:38.279725+0000","last_active":"2024-05-10T03:53:39.264807+0000","last_peered":"2024-05-10T03:53:39.264807+0000","last_clean":"2024-05-10T03:53:39.264807+0000","last_became_active":"2024-05-10T03:53:38.279431+0000","last_became_peered":"2024-05-10T03:53:38.279431+0000","last_unstale":"2024-05-10T03:53:39.264807+0000","last_undegraded":"2024-05-10T03:53:39.264807+0000","last_fullsized":"2024-05-10T03:53:39.264807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739515+0000","last_change":"2024-05-10T03:53:38.285220+0000","last_active":"2024-05-10T03:53:39.739515+0000","last_peered":"2024-05-10T03:53:39.739515+0000","last_clean":"2024-05-10T03:53:39.739515+0000","last_became_active":"2024-05-10T03:53:38.284921+0000","last_became_peered":"2024-05-10T03:53:38.284921+0000","last_unstale":"2024-05-10T03:53:39.739515+0000","last_undegraded":"2024-05-10T03:53:39.739515+0000","last_fullsized":"2024-05-10T03:53:39.739515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739873+0000","last_change":"2024-05-10T03:53:38.294490+0000","last_active":"2024-05-10T03:53:39.739873+0000","last_peered":"2024-05-10T03:53:39.739873+0000","last_clean":"2024-05-10T03:53:39.739873+0000","last_became_active":"2024-05-10T03:53:38.294235+0000","last_became_peered":"2024-05-10T03:53:38.294235+0000","last_unstale":"2024-05-10T03:53:39.739873+0000","last_undegraded":"2024-05-10T03:53:39.739873+0000","last_fullsized":"2024-05-10T03:53:39.739873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282104+0000","last_change":"2024-05-10T03:53:38.283315+0000","last_active":"2024-05-10T03:53:39.282104+0000","last_peered":"2024-05-10T03:53:39.282104+0000","last_clean":"2024-05-10T03:53:39.282104+0000","last_became_active":"2024-05-10T03:53:38.283022+0000","last_became_peered":"2024-05-10T03:53:38.283022+0000","last_unstale":"2024-05-10T03:53:39.282104+0000","last_undegraded":"2024-05-10T03:53:39.282104+0000","last_fullsized":"2024-05-10T03:53:39.282104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740216+0000","last_change":"2024-05-10T03:53:38.272217+0000","last_active":"2024-05-10T03:53:39.740216+0000","last_peered":"2024-05-10T03:53:39.740216+0000","last_clean":"2024-05-10T03:53:39.740216+0000","last_became_active":"2024-05-10T03:53:38.271877+0000","last_became_peered":"2024-05-10T03:53:38.271877+0000","last_unstale":"2024-05-10T03:53:39.740216+0000","last_undegraded":"2024-05-10T03:53:39.740216+0000","last_fullsized":"2024-05-10T03:53:39.740216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263880+0000","last_change":"2024-05-10T03:53:38.277088+0000","last_active":"2024-05-10T03:53:39.263880+0000","last_peered":"2024-05-10T03:53:39.263880+0000","last_clean":"2024-05-10T03:53:39.263880+0000","last_became_active":"2024-05-10T03:53:38.276824+0000","last_became_peered":"2024-05-10T03:53:38.276824+0000","last_unstale":"2024-05-10T03:53:39.263880+0000","last_undegraded":"2024-05-10T03:53:39.263880+0000","last_fullsized":"2024-05-10T03:53:39.263880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739566+0000","last_change":"2024-05-10T03:53:38.288727+0000","last_active":"2024-05-10T03:53:39.739566+0000","last_peered":"2024-05-10T03:53:39.739566+0000","last_clean":"2024-05-10T03:53:39.739566+0000","last_became_active":"2024-05-10T03:53:38.288432+0000","last_became_peered":"2024-05-10T03:53:38.288432+0000","last_unstale":"2024-05-10T03:53:39.739566+0000","last_undegraded":"2024-05-10T03:53:39.739566+0000","last_fullsized":"2024-05-10T03:53:39.739566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263999+0000","last_change":"2024-05-10T03:53:38.280010+0000","last_active":"2024-05-10T03:53:39.263999+0000","last_peered":"2024-05-10T03:53:39.263999+0000","last_clean":"2024-05-10T03:53:39.263999+0000","last_became_active":"2024-05-10T03:53:38.279685+0000","last_became_peered":"2024-05-10T03:53:38.279685+0000","last_unstale":"2024-05-10T03:53:39.263999+0000","last_undegraded":"2024-05-10T03:53:39.263999+0000","last_fullsized":"2024-05-10T03:53:39.263999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740768+0000","last_change":"2024-05-10T03:53:38.289402+0000","last_active":"2024-05-10T03:53:39.740768+0000","last_peered":"2024-05-10T03:53:39.740768+0000","last_clean":"2024-05-10T03:53:39.740768+0000","last_became_active":"2024-05-10T03:53:38.289056+0000","last_became_peered":"2024-05-10T03:53:38.289056+0000","last_unstale":"2024-05-10T03:53:39.740768+0000","last_undegraded":"2024-05-10T03:53:39.740768+0000","last_fullsized":"2024-05-10T03:53:39.740768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282219+0000","last_change":"2024-05-10T03:53:38.285946+0000","last_active":"2024-05-10T03:53:39.282219+0000","last_peered":"2024-05-10T03:53:39.282219+0000","last_clean":"2024-05-10T03:53:39.282219+0000","last_became_active":"2024-05-10T03:53:38.285673+0000","last_became_peered":"2024-05-10T03:53:38.285673+0000","last_unstale":"2024-05-10T03:53:39.282219+0000","last_undegraded":"2024-05-10T03:53:39.282219+0000","last_fullsized":"2024-05-10T03:53:39.282219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265431+0000","last_change":"2024-05-10T03:53:38.284555+0000","last_active":"2024-05-10T03:53:39.265431+0000","last_peered":"2024-05-10T03:53:39.265431+0000","last_clean":"2024-05-10T03:53:39.265431+0000","last_became_active":"2024-05-10T03:53:38.284271+0000","last_became_peered":"2024-05-10T03:53:38.284271+0000","last_unstale":"2024-05-10T03:53:39.265431+0000","last_undegraded":"2024-05-10T03:53:39.265431+0000","last_fullsized":"2024-05-10T03:53:39.265431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740719+0000","last_change":"2024-05-10T03:53:38.287638+0000","last_active":"2024-05-10T03:53:39.740719+0000","last_peered":"2024-05-10T03:53:39.740719+0000","last_clean":"2024-05-10T03:53:39.740719+0000","last_became_active":"2024-05-10T03:53:38.287378+0000","last_became_peered":"2024-05-10T03:53:38.287378+0000","last_unstale":"2024-05-10T03:53:39.740719+0000","last_undegraded":"2024-05-10T03:53:39.740719+0000","last_fullsized":"2024-05-10T03:53:39.740719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740296+0000","last_change":"2024-05-10T03:53:38.285862+0000","last_active":"2024-05-10T03:53:39.740296+0000","last_peered":"2024-05-10T03:53:39.740296+0000","last_clean":"2024-05-10T03:53:39.740296+0000","last_became_active":"2024-05-10T03:53:38.285480+0000","last_became_peered":"2024-05-10T03:53:38.285480+0000","last_unstale":"2024-05-10T03:53:39.740296+0000","last_undegraded":"2024-05-10T03:53:39.740296+0000","last_fullsized":"2024-05-10T03:53:39.740296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264048+0000","last_change":"2024-05-10T03:53:38.288261+0000","last_active":"2024-05-10T03:53:39.264048+0000","last_peered":"2024-05-10T03:53:39.264048+0000","last_clean":"2024-05-10T03:53:39.264048+0000","last_became_active":"2024-05-10T03:53:38.287960+0000","last_became_peered":"2024-05-10T03:53:38.287960+0000","last_unstale":"2024-05-10T03:53:39.264048+0000","last_undegraded":"2024-05-10T03:53:39.264048+0000","last_fullsized":"2024-05-10T03:53:39.264048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739269+0000","last_change":"2024-05-10T03:53:38.281223+0000","last_active":"2024-05-10T03:53:39.739269+0000","last_peered":"2024-05-10T03:53:39.739269+0000","last_clean":"2024-05-10T03:53:39.739269+0000","last_became_active":"2024-05-10T03:53:38.280925+0000","last_became_peered":"2024-05-10T03:53:38.280925+0000","last_unstale":"2024-05-10T03:53:39.739269+0000","last_undegraded":"2024-05-10T03:53:39.739269+0000","last_fullsized":"2024-05-10T03:53:39.739269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281698+0000","last_change":"2024-05-10T03:53:38.281574+0000","last_active":"2024-05-10T03:53:39.281698+0000","last_peered":"2024-05-10T03:53:39.281698+0000","last_clean":"2024-05-10T03:53:39.281698+0000","last_became_active":"2024-05-10T03:53:38.281248+0000","last_became_peered":"2024-05-10T03:53:38.281248+0000","last_unstale":"2024-05-10T03:53:39.281698+0000","last_undegraded":"2024-05-10T03:53:39.281698+0000","last_fullsized":"2024-05-10T03:53:39.281698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265201+0000","last_change":"2024-05-10T03:53:38.286690+0000","last_active":"2024-05-10T03:53:39.265201+0000","last_peered":"2024-05-10T03:53:39.265201+0000","last_clean":"2024-05-10T03:53:39.265201+0000","last_became_active":"2024-05-10T03:53:38.286328+0000","last_became_peered":"2024-05-10T03:53:38.286328+0000","last_unstale":"2024-05-10T03:53:39.265201+0000","last_undegraded":"2024-05-10T03:53:39.265201+0000","last_fullsized":"2024-05-10T03:53:39.265201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:54.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740539+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:39.740539+0000","last_peered":"2024-05-10T03:53:39.740539+0000","last_clean":"2024-05-10T03:53:39.740539+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:39.740539+0000","last_undegraded":"2024-05-10T03:53:39.740539+0000","last_fullsized":"2024-05-10T03:53:39.740539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740368+0000","last_change":"2024-05-10T03:53:38.287761+0000","last_active":"2024-05-10T03:53:39.740368+0000","last_peered":"2024-05-10T03:53:39.740368+0000","last_clean":"2024-05-10T03:53:39.740368+0000","last_became_active":"2024-05-10T03:53:38.286885+0000","last_became_peered":"2024-05-10T03:53:38.286885+0000","last_unstale":"2024-05-10T03:53:39.740368+0000","last_undegraded":"2024-05-10T03:53:39.740368+0000","last_fullsized":"2024-05-10T03:53:39.740368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281751+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:39.281751+0000","last_peered":"2024-05-10T03:53:39.281751+0000","last_clean":"2024-05-10T03:53:39.281751+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:39.281751+0000","last_undegraded":"2024-05-10T03:53:39.281751+0000","last_fullsized":"2024-05-10T03:53:39.281751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739717+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:39.739717+0000","last_peered":"2024-05-10T03:53:39.739717+0000","last_clean":"2024-05-10T03:53:39.739717+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:39.739717+0000","last_undegraded":"2024-05-10T03:53:39.739717+0000","last_fullsized":"2024-05-10T03:53:39.739717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740040+0000","last_change":"2024-05-10T03:53:38.290104+0000","last_active":"2024-05-10T03:53:39.740040+0000","last_peered":"2024-05-10T03:53:39.740040+0000","last_clean":"2024-05-10T03:53:39.740040+0000","last_became_active":"2024-05-10T03:53:38.289798+0000","last_became_peered":"2024-05-10T03:53:38.289798+0000","last_unstale":"2024-05-10T03:53:39.740040+0000","last_undegraded":"2024-05-10T03:53:39.740040+0000","last_fullsized":"2024-05-10T03:53:39.740040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264116+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:39.264116+0000","last_peered":"2024-05-10T03:53:39.264116+0000","last_clean":"2024-05-10T03:53:39.264116+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:39.264116+0000","last_undegraded":"2024-05-10T03:53:39.264116+0000","last_fullsized":"2024-05-10T03:53:39.264116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265151+0000","last_change":"2024-05-10T03:53:38.286333+0000","last_active":"2024-05-10T03:53:39.265151+0000","last_peered":"2024-05-10T03:53:39.265151+0000","last_clean":"2024-05-10T03:53:39.265151+0000","last_became_active":"2024-05-10T03:53:38.284982+0000","last_became_peered":"2024-05-10T03:53:38.284982+0000","last_unstale":"2024-05-10T03:53:39.265151+0000","last_undegraded":"2024-05-10T03:53:39.265151+0000","last_fullsized":"2024-05-10T03:53:39.265151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282035+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:39.282035+0000","last_peered":"2024-05-10T03:53:39.282035+0000","last_clean":"2024-05-10T03:53:39.282035+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:39.282035+0000","last_undegraded":"2024-05-10T03:53:39.282035+0000","last_fullsized":"2024-05-10T03:53:39.282035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264506+0000","last_change":"2024-05-10T03:53:38.282479+0000","last_active":"2024-05-10T03:53:39.264506+0000","last_peered":"2024-05-10T03:53:39.264506+0000","last_clean":"2024-05-10T03:53:39.264506+0000","last_became_active":"2024-05-10T03:53:38.278644+0000","last_became_peered":"2024-05-10T03:53:38.278644+0000","last_unstale":"2024-05-10T03:53:39.264506+0000","last_undegraded":"2024-05-10T03:53:39.264506+0000","last_fullsized":"2024-05-10T03:53:39.264506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264533+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:39.264533+0000","last_peered":"2024-05-10T03:53:39.264533+0000","last_clean":"2024-05-10T03:53:39.264533+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:39.264533+0000","last_undegraded":"2024-05-10T03:53:39.264533+0000","last_fullsized":"2024-05-10T03:53:39.264533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740124+0000","last_change":"2024-05-10T03:53:38.280103+0000","last_active":"2024-05-10T03:53:39.740124+0000","last_peered":"2024-05-10T03:53:39.740124+0000","last_clean":"2024-05-10T03:53:39.740124+0000","last_became_active":"2024-05-10T03:53:38.279821+0000","last_became_peered":"2024-05-10T03:53:38.279821+0000","last_unstale":"2024-05-10T03:53:39.740124+0000","last_undegraded":"2024-05-10T03:53:39.740124+0000","last_fullsized":"2024-05-10T03:53:39.740124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265414+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:39.265414+0000","last_peered":"2024-05-10T03:53:39.265414+0000","last_clean":"2024-05-10T03:53:39.265414+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:39.265414+0000","last_undegraded":"2024-05-10T03:53:39.265414+0000","last_fullsized":"2024-05-10T03:53:39.265414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265514+0000","last_change":"2024-05-10T03:53:38.281500+0000","last_active":"2024-05-10T03:53:39.265514+0000","last_peered":"2024-05-10T03:53:39.265514+0000","last_clean":"2024-05-10T03:53:39.265514+0000","last_became_active":"2024-05-10T03:53:38.281173+0000","last_became_peered":"2024-05-10T03:53:38.281173+0000","last_unstale":"2024-05-10T03:53:39.265514+0000","last_undegraded":"2024-05-10T03:53:39.265514+0000","last_fullsized":"2024-05-10T03:53:39.265514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282038+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:39.282038+0000","last_peered":"2024-05-10T03:53:39.282038+0000","last_clean":"2024-05-10T03:53:39.282038+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:39.282038+0000","last_undegraded":"2024-05-10T03:53:39.282038+0000","last_fullsized":"2024-05-10T03:53:39.282038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739639+0000","last_change":"2024-05-10T03:53:38.290859+0000","last_active":"2024-05-10T03:53:39.739639+0000","last_peered":"2024-05-10T03:53:39.739639+0000","last_clean":"2024-05-10T03:53:39.739639+0000","last_became_active":"2024-05-10T03:53:38.290575+0000","last_became_peered":"2024-05-10T03:53:38.290575+0000","last_unstale":"2024-05-10T03:53:39.739639+0000","last_undegraded":"2024-05-10T03:53:39.739639+0000","last_fullsized":"2024-05-10T03:53:39.739639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740395+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:39.740395+0000","last_peered":"2024-05-10T03:53:39.740395+0000","last_clean":"2024-05-10T03:53:39.740395+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:39.740395+0000","last_undegraded":"2024-05-10T03:53:39.740395+0000","last_fullsized":"2024-05-10T03:53:39.740395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739992+0000","last_change":"2024-05-10T03:53:38.277962+0000","last_active":"2024-05-10T03:53:39.739992+0000","last_peered":"2024-05-10T03:53:39.739992+0000","last_clean":"2024-05-10T03:53:39.739992+0000","last_became_active":"2024-05-10T03:53:38.277601+0000","last_became_peered":"2024-05-10T03:53:38.277601+0000","last_unstale":"2024-05-10T03:53:39.739992+0000","last_undegraded":"2024-05-10T03:53:39.739992+0000","last_fullsized":"2024-05-10T03:53:39.739992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264170+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:39.264170+0000","last_peered":"2024-05-10T03:53:39.264170+0000","last_clean":"2024-05-10T03:53:39.264170+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:39.264170+0000","last_undegraded":"2024-05-10T03:53:39.264170+0000","last_fullsized":"2024-05-10T03:53:39.264170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739591+0000","last_change":"2024-05-10T03:53:38.289892+0000","last_active":"2024-05-10T03:53:39.739591+0000","last_peered":"2024-05-10T03:53:39.739591+0000","last_clean":"2024-05-10T03:53:39.739591+0000","last_became_active":"2024-05-10T03:53:38.289548+0000","last_became_peered":"2024-05-10T03:53:38.289548+0000","last_unstale":"2024-05-10T03:53:39.739591+0000","last_undegraded":"2024-05-10T03:53:39.739591+0000","last_fullsized":"2024-05-10T03:53:39.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281775+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:39.281775+0000","last_peered":"2024-05-10T03:53:39.281775+0000","last_clean":"2024-05-10T03:53:39.281775+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:39.281775+0000","last_undegraded":"2024-05-10T03:53:39.281775+0000","last_fullsized":"2024-05-10T03:53:39.281775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281702+0000","last_change":"2024-05-10T03:53:38.282182+0000","last_active":"2024-05-10T03:53:39.281702+0000","last_peered":"2024-05-10T03:53:39.281702+0000","last_clean":"2024-05-10T03:53:39.281702+0000","last_became_active":"2024-05-10T03:53:38.281876+0000","last_became_peered":"2024-05-10T03:53:38.281876+0000","last_unstale":"2024-05-10T03:53:39.281702+0000","last_undegraded":"2024-05-10T03:53:39.281702+0000","last_fullsized":"2024-05-10T03:53:39.281702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739297+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:39.739297+0000","last_peered":"2024-05-10T03:53:39.739297+0000","last_clean":"2024-05-10T03:53:39.739297+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:39.739297+0000","last_undegraded":"2024-05-10T03:53:39.739297+0000","last_fullsized":"2024-05-10T03:53:39.739297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739300+0000","last_change":"2024-05-10T03:53:38.286582+0000","last_active":"2024-05-10T03:53:39.739300+0000","last_peered":"2024-05-10T03:53:39.739300+0000","last_clean":"2024-05-10T03:53:39.739300+0000","last_became_active":"2024-05-10T03:53:38.286302+0000","last_became_peered":"2024-05-10T03:53:38.286302+0000","last_unstale":"2024-05-10T03:53:39.739300+0000","last_undegraded":"2024-05-10T03:53:39.739300+0000","last_fullsized":"2024-05-10T03:53:39.739300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265577+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:39.265577+0000","last_peered":"2024-05-10T03:53:39.265577+0000","last_clean":"2024-05-10T03:53:39.265577+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:39.265577+0000","last_undegraded":"2024-05-10T03:53:39.265577+0000","last_fullsized":"2024-05-10T03:53:39.265577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739847+0000","last_change":"2024-05-10T03:53:38.285319+0000","last_active":"2024-05-10T03:53:39.739847+0000","last_peered":"2024-05-10T03:53:39.739847+0000","last_clean":"2024-05-10T03:53:39.739847+0000","last_became_active":"2024-05-10T03:53:38.284885+0000","last_became_peered":"2024-05-10T03:53:38.284885+0000","last_unstale":"2024-05-10T03:53:39.739847+0000","last_undegraded":"2024-05-10T03:53:39.739847+0000","last_fullsized":"2024-05-10T03:53:39.739847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739629+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:39.739629+0000","last_peered":"2024-05-10T03:53:39.739629+0000","last_clean":"2024-05-10T03:53:39.739629+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:39.739629+0000","last_undegraded":"2024-05-10T03:53:39.739629+0000","last_fullsized":"2024-05-10T03:53:39.739629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740026+0000","last_change":"2024-05-10T03:53:38.289329+0000","last_active":"2024-05-10T03:53:39.740026+0000","last_peered":"2024-05-10T03:53:39.740026+0000","last_clean":"2024-05-10T03:53:39.740026+0000","last_became_active":"2024-05-10T03:53:38.288826+0000","last_became_peered":"2024-05-10T03:53:38.288826+0000","last_unstale":"2024-05-10T03:53:39.740026+0000","last_undegraded":"2024-05-10T03:53:39.740026+0000","last_fullsized":"2024-05-10T03:53:39.740026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:21.126895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265522+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:39.265522+0000","last_peered":"2024-05-10T03:53:39.265522+0000","last_clean":"2024-05-10T03:53:39.265522+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:39.265522+0000","last_undegraded":"2024-05-10T03:53:39.265522+0000","last_fullsized":"2024-05-10T03:53:39.265522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264802+0000","last_change":"2024-05-10T03:53:38.293738+0000","last_active":"2024-05-10T03:53:39.264802+0000","last_peered":"2024-05-10T03:53:39.264802+0000","last_clean":"2024-05-10T03:53:39.264802+0000","last_became_active":"2024-05-10T03:53:38.293306+0000","last_became_peered":"2024-05-10T03:53:38.293306+0000","last_unstale":"2024-05-10T03:53:39.264802+0000","last_undegraded":"2024-05-10T03:53:39.264802+0000","last_fullsized":"2024-05-10T03:53:39.264802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739497+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:39.739497+0000","last_peered":"2024-05-10T03:53:39.739497+0000","last_clean":"2024-05-10T03:53:39.739497+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:39.739497+0000","last_undegraded":"2024-05-10T03:53:39.739497+0000","last_fullsized":"2024-05-10T03:53:39.739497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739619+0000","last_change":"2024-05-10T03:53:38.285973+0000","last_active":"2024-05-10T03:53:39.739619+0000","last_peered":"2024-05-10T03:53:39.739619+0000","last_clean":"2024-05-10T03:53:39.739619+0000","last_became_active":"2024-05-10T03:53:38.285695+0000","last_became_peered":"2024-05-10T03:53:38.285695+0000","last_unstale":"2024-05-10T03:53:39.739619+0000","last_undegraded":"2024-05-10T03:53:39.739619+0000","last_fullsized":"2024-05-10T03:53:39.739619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739339+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:39.739339+0000","last_peered":"2024-05-10T03:53:39.739339+0000","last_clean":"2024-05-10T03:53:39.739339+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:39.739339+0000","last_undegraded":"2024-05-10T03:53:39.739339+0000","last_fullsized":"2024-05-10T03:53:39.739339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263868+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:39.263868+0000","last_peered":"2024-05-10T03:53:39.263868+0000","last_clean":"2024-05-10T03:53:39.263868+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:39.263868+0000","last_undegraded":"2024-05-10T03:53:39.263868+0000","last_fullsized":"2024-05-10T03:53:39.263868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739475+0000","last_change":"2024-05-10T03:53:38.289280+0000","last_active":"2024-05-10T03:53:39.739475+0000","last_peered":"2024-05-10T03:53:39.739475+0000","last_clean":"2024-05-10T03:53:39.739475+0000","last_became_active":"2024-05-10T03:53:38.288941+0000","last_became_peered":"2024-05-10T03:53:38.288941+0000","last_unstale":"2024-05-10T03:53:39.739475+0000","last_undegraded":"2024-05-10T03:53:39.739475+0000","last_fullsized":"2024-05-10T03:53:39.739475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739157+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:39.739157+0000","last_peered":"2024-05-10T03:53:39.739157+0000","last_clean":"2024-05-10T03:53:39.739157+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:39.739157+0000","last_undegraded":"2024-05-10T03:53:39.739157+0000","last_fullsized":"2024-05-10T03:53:39.739157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739532+0000","last_change":"2024-05-10T03:53:38.287044+0000","last_active":"2024-05-10T03:53:39.739532+0000","last_peered":"2024-05-10T03:53:39.739532+0000","last_clean":"2024-05-10T03:53:39.739532+0000","last_became_active":"2024-05-10T03:53:38.286731+0000","last_became_peered":"2024-05-10T03:53:38.286731+0000","last_unstale":"2024-05-10T03:53:39.739532+0000","last_undegraded":"2024-05-10T03:53:39.739532+0000","last_fullsized":"2024-05-10T03:53:39.739532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:05.026634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739381+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:39.739381+0000","last_peered":"2024-05-10T03:53:39.739381+0000","last_clean":"2024-05-10T03:53:39.739381+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:39.739381+0000","last_undegraded":"2024-05-10T03:53:39.739381+0000","last_fullsized":"2024-05-10T03:53:39.739381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265186+0000","last_change":"2024-05-10T03:53:38.273845+0000","last_active":"2024-05-10T03:53:39.265186+0000","last_peered":"2024-05-10T03:53:39.265186+0000","last_clean":"2024-05-10T03:53:39.265186+0000","last_became_active":"2024-05-10T03:53:38.273237+0000","last_became_peered":"2024-05-10T03:53:38.273237+0000","last_unstale":"2024-05-10T03:53:39.265186+0000","last_undegraded":"2024-05-10T03:53:39.265186+0000","last_fullsized":"2024-05-10T03:53:39.265186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264285+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:39.264285+0000","last_peered":"2024-05-10T03:53:39.264285+0000","last_clean":"2024-05-10T03:53:39.264285+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:39.264285+0000","last_undegraded":"2024-05-10T03:53:39.264285+0000","last_fullsized":"2024-05-10T03:53:39.264285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265435+0000","last_change":"2024-05-10T03:53:38.281466+0000","last_active":"2024-05-10T03:53:39.265435+0000","last_peered":"2024-05-10T03:53:39.265435+0000","last_clean":"2024-05-10T03:53:39.265435+0000","last_became_active":"2024-05-10T03:53:38.281104+0000","last_became_peered":"2024-05-10T03:53:38.281104+0000","last_unstale":"2024-05-10T03:53:39.265435+0000","last_undegraded":"2024-05-10T03:53:39.265435+0000","last_fullsized":"2024-05-10T03:53:39.265435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265302+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:39.265302+0000","last_peered":"2024-05-10T03:53:39.265302+0000","last_clean":"2024-05-10T03:53:39.265302+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:39.265302+0000","last_undegraded":"2024-05-10T03:53:39.265302+0000","last_fullsized":"2024-05-10T03:53:39.265302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264277+0000","last_change":"2024-05-10T03:53:38.287931+0000","last_active":"2024-05-10T03:53:39.264277+0000","last_peered":"2024-05-10T03:53:39.264277+0000","last_clean":"2024-05-10T03:53:39.264277+0000","last_became_active":"2024-05-10T03:53:38.287647+0000","last_became_peered":"2024-05-10T03:53:38.287647+0000","last_unstale":"2024-05-10T03:53:39.264277+0000","last_undegraded":"2024-05-10T03:53:39.264277+0000","last_fullsized":"2024-05-10T03:53:39.264277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739944+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:39.739944+0000","last_peered":"2024-05-10T03:53:39.739944+0000","last_clean":"2024-05-10T03:53:39.739944+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:39.739944+0000","last_undegraded":"2024-05-10T03:53:39.739944+0000","last_fullsized":"2024-05-10T03:53:39.739944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265284+0000","last_change":"2024-05-10T03:53:38.280342+0000","last_active":"2024-05-10T03:53:39.265284+0000","last_peered":"2024-05-10T03:53:39.265284+0000","last_clean":"2024-05-10T03:53:39.265284+0000","last_became_active":"2024-05-10T03:53:38.279318+0000","last_became_peered":"2024-05-10T03:53:38.279318+0000","last_unstale":"2024-05-10T03:53:39.265284+0000","last_undegraded":"2024-05-10T03:53:39.265284+0000","last_fullsized":"2024-05-10T03:53:39.265284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265488+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:39.265488+0000","last_peered":"2024-05-10T03:53:39.265488+0000","last_clean":"2024-05-10T03:53:39.265488+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:39.265488+0000","last_undegraded":"2024-05-10T03:53:39.265488+0000","last_fullsized":"2024-05-10T03:53:39.265488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740780+0000","last_change":"2024-05-10T03:53:38.290232+0000","last_active":"2024-05-10T03:53:39.740780+0000","last_peered":"2024-05-10T03:53:39.740780+0000","last_clean":"2024-05-10T03:53:39.740780+0000","last_became_active":"2024-05-10T03:53:38.289945+0000","last_became_peered":"2024-05-10T03:53:38.289945+0000","last_unstale":"2024-05-10T03:53:39.740780+0000","last_undegraded":"2024-05-10T03:53:39.740780+0000","last_fullsized":"2024-05-10T03:53:39.740780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282115+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:39.282115+0000","last_peered":"2024-05-10T03:53:39.282115+0000","last_clean":"2024-05-10T03:53:39.282115+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:39.282115+0000","last_undegraded":"2024-05-10T03:53:39.282115+0000","last_fullsized":"2024-05-10T03:53:39.282115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740024+0000","last_change":"2024-05-10T03:53:38.277345+0000","last_active":"2024-05-10T03:53:39.740024+0000","last_peered":"2024-05-10T03:53:39.740024+0000","last_clean":"2024-05-10T03:53:39.740024+0000","last_became_active":"2024-05-10T03:53:38.273372+0000","last_became_peered":"2024-05-10T03:53:38.273372+0000","last_unstale":"2024-05-10T03:53:39.740024+0000","last_undegraded":"2024-05-10T03:53:39.740024+0000","last_fullsized":"2024-05-10T03:53:39.740024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739148+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:39.739148+0000","last_peered":"2024-05-10T03:53:39.739148+0000","last_clean":"2024-05-10T03:53:39.739148+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:39.739148+0000","last_undegraded":"2024-05-10T03:53:39.739148+0000","last_fullsized":"2024-05-10T03:53:39.739148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265162+0000","last_change":"2024-05-10T03:53:38.271356+0000","last_active":"2024-05-10T03:53:39.265162+0000","last_peered":"2024-05-10T03:53:39.265162+0000","last_clean":"2024-05-10T03:53:39.265162+0000","last_became_active":"2024-05-10T03:53:38.271041+0000","last_became_peered":"2024-05-10T03:53:38.271041+0000","last_unstale":"2024-05-10T03:53:39.265162+0000","last_undegraded":"2024-05-10T03:53:39.265162+0000","last_fullsized":"2024-05-10T03:53:39.265162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:02.308236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265262+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:39.265262+0000","last_peered":"2024-05-10T03:53:39.265262+0000","last_clean":"2024-05-10T03:53:39.265262+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:39.265262+0000","last_undegraded":"2024-05-10T03:53:39.265262+0000","last_fullsized":"2024-05-10T03:53:39.265262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740183+0000","last_change":"2024-05-10T03:53:38.283634+0000","last_active":"2024-05-10T03:53:39.740183+0000","last_peered":"2024-05-10T03:53:39.740183+0000","last_clean":"2024-05-10T03:53:39.740183+0000","last_became_active":"2024-05-10T03:53:38.283346+0000","last_became_peered":"2024-05-10T03:53:38.283346+0000","last_unstale":"2024-05-10T03:53:39.740183+0000","last_undegraded":"2024-05-10T03:53:39.740183+0000","last_fullsized":"2024-05-10T03:53:39.740183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265349+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:39.265349+0000","last_peered":"2024-05-10T03:53:39.265349+0000","last_clean":"2024-05-10T03:53:39.265349+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:39.265349+0000","last_undegraded":"2024-05-10T03:53:39.265349+0000","last_fullsized":"2024-05-10T03:53:39.265349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740534+0000","last_change":"2024-05-10T03:53:38.283122+0000","last_active":"2024-05-10T03:53:39.740534+0000","last_peered":"2024-05-10T03:53:39.740534+0000","last_clean":"2024-05-10T03:53:39.740534+0000","last_became_active":"2024-05-10T03:53:38.282829+0000","last_became_peered":"2024-05-10T03:53:38.282829+0000","last_unstale":"2024-05-10T03:53:39.740534+0000","last_undegraded":"2024-05-10T03:53:39.740534+0000","last_fullsized":"2024-05-10T03:53:39.740534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739663+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:39.739663+0000","last_peered":"2024-05-10T03:53:39.739663+0000","last_clean":"2024-05-10T03:53:39.739663+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:39.739663+0000","last_undegraded":"2024-05-10T03:53:39.739663+0000","last_fullsized":"2024-05-10T03:53:39.739663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282013+0000","last_change":"2024-05-10T03:53:38.287504+0000","last_active":"2024-05-10T03:53:39.282013+0000","last_peered":"2024-05-10T03:53:39.282013+0000","last_clean":"2024-05-10T03:53:39.282013+0000","last_became_active":"2024-05-10T03:53:38.287245+0000","last_became_peered":"2024-05-10T03:53:38.287245+0000","last_unstale":"2024-05-10T03:53:39.282013+0000","last_undegraded":"2024-05-10T03:53:39.282013+0000","last_fullsized":"2024-05-10T03:53:39.282013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264216+0000","last_change":"2024-05-10T03:53:38.282467+0000","last_active":"2024-05-10T03:53:39.264216+0000","last_peered":"2024-05-10T03:53:39.264216+0000","last_clean":"2024-05-10T03:53:39.264216+0000","last_became_active":"2024-05-10T03:53:38.282177+0000","last_became_peered":"2024-05-10T03:53:38.282177+0000","last_unstale":"2024-05-10T03:53:39.264216+0000","last_undegraded":"2024-05-10T03:53:39.264216+0000","last_fullsized":"2024-05-10T03:53:39.264216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739507+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:39.739507+0000","last_peered":"2024-05-10T03:53:39.739507+0000","last_clean":"2024-05-10T03:53:39.739507+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:39.739507+0000","last_undegraded":"2024-05-10T03:53:39.739507+0000","last_fullsized":"2024-05-10T03:53:39.739507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264617+0000","last_change":"2024-05-10T03:53:38.287053+0000","last_active":"2024-05-10T03:53:39.264617+0000","last_peered":"2024-05-10T03:53:39.264617+0000","last_clean":"2024-05-10T03:53:39.264617+0000","last_became_active":"2024-05-10T03:53:38.286767+0000","last_became_peered":"2024-05-10T03:53:38.286767+0000","last_unstale":"2024-05-10T03:53:39.264617+0000","last_undegraded":"2024-05-10T03:53:39.264617+0000","last_fullsized":"2024-05-10T03:53:39.264617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739812+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:39.739812+0000","last_peered":"2024-05-10T03:53:39.739812+0000","last_clean":"2024-05-10T03:53:39.739812+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:39.739812+0000","last_undegraded":"2024-05-10T03:53:39.739812+0000","last_fullsized":"2024-05-10T03:53:39.739812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740006+0000","last_change":"2024-05-10T03:53:38.281054+0000","last_active":"2024-05-10T03:53:39.740006+0000","last_peered":"2024-05-10T03:53:39.740006+0000","last_clean":"2024-05-10T03:53:39.740006+0000","last_became_active":"2024-05-10T03:53:38.280762+0000","last_became_peered":"2024-05-10T03:53:38.280762+0000","last_unstale":"2024-05-10T03:53:39.740006+0000","last_undegraded":"2024-05-10T03:53:39.740006+0000","last_fullsized":"2024-05-10T03:53:39.740006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740638+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:39.740638+0000","last_peered":"2024-05-10T03:53:39.740638+0000","last_clean":"2024-05-10T03:53:39.740638+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:39.740638+0000","last_undegraded":"2024-05-10T03:53:39.740638+0000","last_fullsized":"2024-05-10T03:53:39.740638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740557+0000","last_change":"2024-05-10T03:53:38.285034+0000","last_active":"2024-05-10T03:53:39.740557+0000","last_peered":"2024-05-10T03:53:39.740557+0000","last_clean":"2024-05-10T03:53:39.740557+0000","last_became_active":"2024-05-10T03:53:38.284756+0000","last_became_peered":"2024-05-10T03:53:38.284756+0000","last_unstale":"2024-05-10T03:53:39.740557+0000","last_undegraded":"2024-05-10T03:53:39.740557+0000","last_fullsized":"2024-05-10T03:53:39.740557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740208+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:39.740208+0000","last_peered":"2024-05-10T03:53:39.740208+0000","last_clean":"2024-05-10T03:53:39.740208+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:39.740208+0000","last_undegraded":"2024-05-10T03:53:39.740208+0000","last_fullsized":"2024-05-10T03:53:39.740208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":802816,"data_stored":661498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":70708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":811008,"data_stored":661554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:47.237 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T03:53:47.237 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T03:53:47.238 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T03:53:47.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T03:53:47.238 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T03:53:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.373+0000 7f5c28e75640 1 Processor -- start 2024-05-10T03:53:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.373+0000 7f5c28e75640 1 -- start start 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c28e75640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 0x7f5c240d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c28e75640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c24160a10 con 0x7f5c240d2980 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c28e75640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c24160450 con 0x7f5c240d3fb0 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c28e75640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5c24160730 con 0x7f5c2415f3d0 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c21d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5c240d2980 0x7f5c240d38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39638/0 (socket says 172.21.15.55:39638) 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c21d9b640 1 -- 172.21.15.55:0/2972944786 learned_addr learned my addr 172.21.15.55:0/2972944786 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.374+0000 7f5c2259c640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 0x7f5c240d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789739411 0 0) 0x7f5c24160a10 con 0x7f5c240d2980 2024-05-10T03:53:47.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c0c003520 con 0x7f5c240d2980 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513899888 0 0) 0x7f5c24160450 con 0x7f5c240d3fb0 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c24160a10 con 0x7f5c240d3fb0 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2454847891 0 0) 0x7f5c0c003520 con 0x7f5c240d2980 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 msgr2=0x7f5c240d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 0x7f5c240d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 >> v1:172.21.15.64:6789/0 conn(0x7f5c240d3fb0 legacy=0x7f5c240b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c240d1c40 con 0x7f5c240d2980 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f5c18001710 con 0x7f5c240d2980 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 >> v1:172.21.15.55:6789/0 conn(0x7f5c240d2980 legacy=0x7f5c240d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0c003c10 0x7f5c0c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 0x7f5c0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c004d40 0x7f5c0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24160730 con 0x7f5c0c003c10 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c00bb50 con 0x7f5c0c004d40 2024-05-10T03:53:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0c00bd20 con 0x7f5c2415f3d0 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2259c640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0c003c10 0x7f5c0c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c21d9b640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 0x7f5c0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c22d9d640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c004d40 0x7f5c0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2259c640 1 -- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 msgr2=0x7f5c0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2259c640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c2415f3d0 0x7f5c0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2259c640 1 -- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c004d40 msgr2=0x7f5c0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2259c640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c004d40 0x7f5c0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.375+0000 7f5c2259c640 1 -- 172.21.15.55:0/2972944786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c003520 con 0x7f5c0c003c10 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.376+0000 7f5c2259c640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0c003c10 0x7f5c0c004010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009af0 tx=0x7f5c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e38ab6c3c6f56 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.376+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14036070 con 0x7f5c0c003c10 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.376+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c14031400 con 0x7f5c0c003c10 2024-05-10T03:53:47.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.376+0000 7f5c2159a640 1 -- 172.21.15.55:0/2972944786 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14009690 con 0x7f5c0c003c10 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c28e75640 1 -- 172.21.15.55:0/2972944786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0c003c10 msgr2=0x7f5c0c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c28e75640 1 --2- 172.21.15.55:0/2972944786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c0c003c10 0x7f5c0c004010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009af0 tx=0x7f5c0c005830 comp rx=0 tx=0).stop 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c22d9d640 1 -- 172.21.15.55:0/2972944786 reap_dead start 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c28e75640 1 -- 172.21.15.55:0/2972944786 shutdown_connections 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c28e75640 1 -- 172.21.15.55:0/2972944786 >> 172.21.15.55:0/2972944786 conn(0x7f5c2408ed00 msgr2=0x7f5c2409e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c28e75640 1 -- 172.21.15.55:0/2972944786 shutdown_connections 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.377+0000 7f5c28e75640 1 -- 172.21.15.55:0/2972944786 wait complete. 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.378+0000 7f5c28e75640 1 Processor -- start 2024-05-10T03:53:47.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.378+0000 7f5c28e75640 1 -- start start 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c28e75640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c003c10 0x7f5c240c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c28e75640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c241513a0 0x7f5c240c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c28e75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 0x7f5c240cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c28e75640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240b57f0 con 0x7f5c240cdf40 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c28e75640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5c240b5670 con 0x7f5c0c003c10 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c28e75640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5c240c9db0 con 0x7f5c241513a0 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 0x7f5c240cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 0x7f5c240cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56654/0 (socket says 172.21.15.55:56654) 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 -- 172.21.15.55:0/3445287158 learned_addr learned my addr 172.21.15.55:0/3445287158 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c21d9b640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c241513a0 0x7f5c240c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c2259c640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c003c10 0x7f5c240c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 -- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c241513a0 msgr2=0x7f5c240c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c241513a0 0x7f5c240c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 -- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c003c10 msgr2=0x7f5c240c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c003c10 0x7f5c240c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 -- 172.21.15.55:0/3445287158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c240ca090 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.379+0000 7f5c22d9d640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 0x7f5c240cae50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c001330 tx=0x7f5c1c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.380+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c006b50 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.380+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c006d10 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.380+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c003970 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.380+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c240ca370 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.380+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c240ca930 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.381+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c240d3480 con 0x7f5c240cdf40 2024-05-10T03:53:47.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.381+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c1c01a020 con 0x7f5c240cdf40 2024-05-10T03:53:47.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.382+0000 7f5c12ffd640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5c04076300 0x7f5c040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.382+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5c1c096d00 con 0x7f5c240cdf40 2024-05-10T03:53:47.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.382+0000 7f5c2259c640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5c04076300 0x7f5c040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.382+0000 7f5c2259c640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5c04076300 0x7f5c040787c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c14033000 tx=0x7f5c14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.386+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c240d3480 con 0x7f5c240cdf40 2024-05-10T03:53:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.627+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5c240cab30 con 0x7f5c240cdf40 2024-05-10T03:53:47.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.630+0000 7f5c12ffd640 1 -- 172.21.15.55:0/3445287158 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189520 (secure 0 0 0) 0x7f5c240cab30 con 0x7f5c240cdf40 2024-05-10T03:53:47.638 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:47.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5c04076300 msgr2=0x7f5c040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5c04076300 0x7f5c040787c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c14033000 tx=0x7f5c14008030 comp rx=0 tx=0).stop 2024-05-10T03:53:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 msgr2=0x7f5c240cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 0x7f5c240cae50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c001330 tx=0x7f5c1c00eb50 comp rx=0 tx=0).stop 2024-05-10T03:53:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 shutdown_connections 2024-05-10T03:53:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5c04076300 0x7f5c040787c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c240cdf40 0x7f5c240cae50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c241513a0 0x7f5c240c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 --2- 172.21.15.55:0/3445287158 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c0c003c10 0x7f5c240c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 >> 172.21.15.55:0/3445287158 conn(0x7f5c2408ed00 msgr2=0x7f5c2406dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 shutdown_connections 2024-05-10T03:53:47.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.633+0000 7f5c28e75640 1 -- 172.21.15.55:0/3445287158 wait complete. 2024-05-10T03:53:47.647 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2693796855},{"type":"v1","addr":"172.21.15.55:6833","nonce":2693796855}]},"active_addr":"172.21.15.55:6833/2693796855","active_change":"2024-05-10T03:53:25.774321+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":136769212}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2085753115}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1881735235}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1590786003}]}]} 2024-05-10T03:53:47.654 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T03:53:47.655 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T03:53:47.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.756+0000 7efe74cc4640 1 Processor -- start 2024-05-10T03:53:47.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.756+0000 7efe74cc4640 1 -- start start 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe74cc4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 0x7efe700d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe74cc4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe700d3de0 0x7efe700b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe74cc4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe700d2b50 con 0x7efe7015f3d0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe74cc4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7efe70160a10 con 0x7efe700d3de0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe74cc4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efe70160450 con 0x7efe700d3360 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe6e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efe7015f3d0 0x7efe700d2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39654/0 (socket says 172.21.15.55:39654) 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.757+0000 7efe6e59c640 1 -- 172.21.15.55:0/26171509 learned_addr learned my addr 172.21.15.55:0/26171509 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 --2- 172.21.15.55:0/26171509 >> v2:172.21.15.64:3300/0 conn(0x7efe700d3de0 0x7efe700b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6dd9b640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 0x7efe700d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456206454 0 0) 0x7efe700d2b50 con 0x7efe7015f3d0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5c003520 con 0x7efe7015f3d0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 459836253 0 0) 0x7efe5c003520 con 0x7efe7015f3d0 2024-05-10T03:53:47.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 msgr2=0x7efe700d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 0x7efe700d38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 >> v2:172.21.15.64:3300/0 conn(0x7efe700d3de0 msgr2=0x7efe700b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 --2- 172.21.15.55:0/26171509 >> v2:172.21.15.64:3300/0 conn(0x7efe700d3de0 0x7efe700b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70160730 con 0x7efe7015f3d0 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7efe68001a70 con 0x7efe7015f3d0 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 >> v1:172.21.15.55:6789/0 conn(0x7efe7015f3d0 legacy=0x7efe700d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe5c003a00 0x7efe5c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 0x7efe5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe5c004d40 0x7efe5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7efe70160a10 con 0x7efe5c004d40 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efe70160450 con 0x7efe5c003a00 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efe5c00b9f0 con 0x7efe700d3360 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe5c004d40 0x7efe5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6e59c640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe5c003a00 0x7efe5c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6dd9b640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 0x7efe5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 -- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 msgr2=0x7efe5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe700d3360 0x7efe5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 -- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe5c003a00 msgr2=0x7efe5c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe5c003a00 0x7efe5c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.758+0000 7efe6ed9d640 1 -- 172.21.15.55:0/26171509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c003520 con 0x7efe5c004d40 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.759+0000 7efe6ed9d640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe5c004d40 0x7efe5c0051c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe60009ac0 tx=0x7efe5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbe3560ae4dda44 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.759+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60036070 con 0x7efe5c004d40 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.759+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60031400 con 0x7efe5c004d40 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.759+0000 7efe6d59a640 1 -- 172.21.15.55:0/26171509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60009690 con 0x7efe5c004d40 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe74cc4640 1 -- 172.21.15.55:0/26171509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe5c004d40 msgr2=0x7efe5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe74cc4640 1 --2- 172.21.15.55:0/26171509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe5c004d40 0x7efe5c0051c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe60009ac0 tx=0x7efe5c005830 comp rx=0 tx=0).stop 2024-05-10T03:53:47.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe6ed9d640 1 -- 172.21.15.55:0/26171509 reap_dead start 2024-05-10T03:53:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe74cc4640 1 -- 172.21.15.55:0/26171509 shutdown_connections 2024-05-10T03:53:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe74cc4640 1 -- 172.21.15.55:0/26171509 >> 172.21.15.55:0/26171509 conn(0x7efe7008ed00 msgr2=0x7efe7009e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe74cc4640 1 -- 172.21.15.55:0/26171509 shutdown_connections 2024-05-10T03:53:47.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.760+0000 7efe74cc4640 1 -- 172.21.15.55:0/26171509 wait complete. 2024-05-10T03:53:47.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.761+0000 7efe74cc4640 1 Processor -- start 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.761+0000 7efe74cc4640 1 -- start start 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe74cc4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe5c004d40 0x7efe7015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe74cc4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 0x7efe7015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe74cc4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe7006d150 0x7efe7006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe74cc4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7efe700d38a0 con 0x7efe7015b5f0 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe74cc4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efe700d1f20 con 0x7efe7006d150 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe74cc4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efe700d3a20 con 0x7efe5c004d40 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 0x7efe7015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 0x7efe7015ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56668/0 (socket says 172.21.15.55:56668) 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 -- 172.21.15.55:0/3580727172 learned_addr learned my addr 172.21.15.55:0/3580727172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6ed9d640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe7006d150 0x7efe7006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6e59c640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe5c004d40 0x7efe7015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 -- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe5c004d40 msgr2=0x7efe7015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe5c004d40 0x7efe7015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 -- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe7006d150 msgr2=0x7efe7006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe7006d150 0x7efe7006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6dd9b640 1 -- 172.21.15.55:0/3580727172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7015b3d0 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.762+0000 7efe6e59c640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe5c004d40 0x7efe7015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.763+0000 7efe6dd9b640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 0x7efe7015ba50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe580119d0 tx=0x7efe58011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.763+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5800fb50 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.763+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5800fcf0 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.763+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7015c910 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.763+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5800fea0 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.763+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7015c350 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.764+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe700a3290 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.764+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe58012040 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.765+0000 7efe66ffd640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe500762d0 0x7efe50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.765+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe58097c10 con 0x7efe7015b5f0 2024-05-10T03:53:47.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.765+0000 7efe6e59c640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe500762d0 0x7efe50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:47.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.765+0000 7efe6e59c640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe500762d0 0x7efe50078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe68004d00 tx=0x7efe68006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:47.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.769+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efe58019030 con 0x7efe7015b5f0 2024-05-10T03:53:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.961+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe701600c0 con 0x7efe7015b5f0 2024-05-10T03:53:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.962+0000 7efe66ffd640 1 -- 172.21.15.55:0/3580727172 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7efe58061570 con 0x7efe7015b5f0 2024-05-10T03:53:47.965 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:47.965 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe500762d0 msgr2=0x7efe50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe500762d0 0x7efe50078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe68004d00 tx=0x7efe68006040 comp rx=0 tx=0).stop 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 msgr2=0x7efe7015ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 0x7efe7015ba50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe580119d0 tx=0x7efe58011e90 comp rx=0 tx=0).stop 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 shutdown_connections 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe7006d150 0x7efe7006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe500762d0 0x7efe50078790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7015b5f0 0x7efe7015ba50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 --2- 172.21.15.55:0/3580727172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe5c004d40 0x7efe7015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 >> 172.21.15.55:0/3580727172 conn(0x7efe7008ed00 msgr2=0x7efe7015f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 shutdown_connections 2024-05-10T03:53:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:47.964+0000 7efe74cc4640 1 -- 172.21.15.55:0/3580727172 wait complete. 2024-05-10T03:53:47.978 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T03:53:47.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:48.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.079+0000 7f1827d14640 1 Processor -- start 2024-05-10T03:53:48.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.080+0000 7f1827d14640 1 -- start start 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.080+0000 7f1827d14640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f18200d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.080+0000 7f1827d14640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1820163410 con 0x7f18200d2fd0 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.080+0000 7f1827d14640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18201636f0 con 0x7f1820162f80 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.080+0000 7f1827d14640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f18201639d0 con 0x7f18200d3ad0 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f18262b1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f18200d2fd0 0x7f182006eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39658/0 (socket says 172.21.15.55:39658) 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f18262b1640 1 -- 172.21.15.55:0/3045748397 learned_addr learned my addr 172.21.15.55:0/3045748397 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1825ab0640 1 --2- 172.21.15.55:0/3045748397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f18200d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534681853 0 0) 0x7f1820163410 con 0x7f18200d2fd0 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f180c003520 con 0x7f18200d2fd0 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1157501718 0 0) 0x7f18201636f0 con 0x7f1820162f80 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1820163410 con 0x7f1820162f80 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1240279443 0 0) 0x7f180c003520 con 0x7f18200d2fd0 2024-05-10T03:53:48.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1825ab0640 1 -- 172.21.15.55:0/3045748397 >> v1:172.21.15.64:6789/0 conn(0x7f1820162f80 legacy=0x7f18200d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1825ab0640 1 -- 172.21.15.55:0/3045748397 >> v1:172.21.15.55:6789/0 conn(0x7f18200d2fd0 legacy=0x7f182006eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.081+0000 7f1825ab0640 1 -- 172.21.15.55:0/3045748397 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1820163cb0 con 0x7f18200d3ad0 2024-05-10T03:53:48.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.082+0000 7f1825ab0640 1 --2- 172.21.15.55:0/3045748397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f18200d2a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097d0 tx=0x7f181c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d92f5bbe052447 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.082+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c037070 con 0x7f18200d3ad0 2024-05-10T03:53:48.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.082+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c02ab90 con 0x7f18200d3ad0 2024-05-10T03:53:48.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.082+0000 7f1824aae640 1 -- 172.21.15.55:0/3045748397 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1818001a70 con 0x7f18200d3ad0 2024-05-10T03:53:48.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 -- 172.21.15.55:0/3045748397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 msgr2=0x7f18200d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 --2- 172.21.15.55:0/3045748397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f18200d2a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097d0 tx=0x7f181c02a100 comp rx=0 tx=0).stop 2024-05-10T03:53:48.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 -- 172.21.15.55:0/3045748397 shutdown_connections 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 --2- 172.21.15.55:0/3045748397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f18200d2a90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 -- 172.21.15.55:0/3045748397 >> 172.21.15.55:0/3045748397 conn(0x7f1820071f80 msgr2=0x7f1820072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 -- 172.21.15.55:0/3045748397 shutdown_connections 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.083+0000 7f1827d14640 1 -- 172.21.15.55:0/3045748397 wait complete. 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.084+0000 7f1827d14640 1 Processor -- start 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.084+0000 7f1827d14640 1 -- start start 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 0x7f18201f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f1820158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18200b7880 0x7f182015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f18200d3eb0 con 0x7f18200d2fd0 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f18200d15a0 con 0x7f18200b7880 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f182006f220 con 0x7f18200d3ad0 2024-05-10T03:53:48.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 0x7f18201f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 0x7f18201f5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56674/0 (socket says 172.21.15.55:56674) 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 -- 172.21.15.55:0/710224964 learned_addr learned my addr 172.21.15.55:0/710224964 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18262b1640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18200b7880 0x7f182015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18252af640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f1820158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 -- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 msgr2=0x7f1820158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f1820158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 -- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18200b7880 msgr2=0x7f182015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18200b7880 0x7f182015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 -- 172.21.15.55:0/710224964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18201f5980 con 0x7f18200d2fd0 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18262b1640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18200b7880 0x7f182015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18252af640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f1820158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1825ab0640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 0x7f18201f5440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097d0 tx=0x7f181c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c037050 con 0x7f18200d2fd0 2024-05-10T03:53:48.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c043070 con 0x7f18200d2fd0 2024-05-10T03:53:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18200b8460 con 0x7f18200d2fd0 2024-05-10T03:53:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c006e10 con 0x7f18200d2fd0 2024-05-10T03:53:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.085+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18200b8a20 con 0x7f18200d2fd0 2024-05-10T03:53:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.086+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1820071ac0 con 0x7f18200d2fd0 2024-05-10T03:53:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.087+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f181c03ca30 con 0x7f18200d2fd0 2024-05-10T03:53:48.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.087+0000 7f18167fc640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f18040762d0 0x7f1804078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.088+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f181c0b8050 con 0x7f18200d2fd0 2024-05-10T03:53:48.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.088+0000 7f18252af640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f18040762d0 0x7f1804078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.088+0000 7f18252af640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f18040762d0 0x7f1804078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f18200d2bb0 tx=0x7f1810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.092+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f181c0819b0 con 0x7f18200d2fd0 2024-05-10T03:53:48.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.283+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1820162950 con 0x7f18200d2fd0 2024-05-10T03:53:48.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.284+0000 7f18167fc640 1 -- 172.21.15.55:0/710224964 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7f181c0812b0 con 0x7f18200d2fd0 2024-05-10T03:53:48.287 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:48.288 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:48.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f18040762d0 msgr2=0x7f1804078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f18040762d0 0x7f1804078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f18200d2bb0 tx=0x7f1810009040 comp rx=0 tx=0).stop 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 msgr2=0x7f18201f5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 0x7f18201f5440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097d0 tx=0x7f181c0046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 shutdown_connections 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18200b7880 0x7f182015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.286+0000 7f1827d14640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f18200d3ad0 0x7f1820158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.287+0000 7f1827d14640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f18040762d0 0x7f1804078790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.287+0000 7f1827d14640 1 --2- 172.21.15.55:0/710224964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18200d2fd0 0x7f18201f5440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.287+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 >> 172.21.15.55:0/710224964 conn(0x7f1820071f80 msgr2=0x7f182015fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.287+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 shutdown_connections 2024-05-10T03:53:48.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.287+0000 7f1827d14640 1 -- 172.21.15.55:0/710224964 wait complete. 2024-05-10T03:53:48.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T03:53:48.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T03:53:48.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T03:53:48.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T03:53:48.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T03:53:48.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T03:53:48.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T03:53:48.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T03:53:48.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.482+0000 7fcda7fff640 1 Processor -- start 2024-05-10T03:53:48.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7f1c870f6640 1 Processor -- start 2024-05-10T03:53:48.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7f1c870f6640 1 -- start start 2024-05-10T03:53:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.482+0000 7fcda7fff640 1 -- start start 2024-05-10T03:53:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7fcda7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcda0048be0 0x7fcda0053fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7fcda7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda0048fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7fcda7fff640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda003bae0 con 0x7fcda0034b10 2024-05-10T03:53:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7fcda7fff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fcda003b2d0 con 0x7fcda0048be0 2024-05-10T03:53:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7fcda7fff640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcda000b510 con 0x7fcda0035040 2024-05-10T03:53:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda67fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda0048fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcda0034b10 0x7fcda000b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39668/0 (socket says 172.21.15.55:39668) 2024-05-10T03:53:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda77fe640 1 -- 172.21.15.55:0/3883875118 learned_addr learned my addr 172.21.15.55:0/3883875118 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/3883875118 >> v2:172.21.15.64:3300/0 conn(0x7fcda0048be0 0x7fcda0053fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda5ffb640 1 -- 172.21.15.55:0/3883875118 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443063221 0 0) 0x7fcda003bae0 con 0x7fcda0034b10 2024-05-10T03:53:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda5ffb640 1 -- 172.21.15.55:0/3883875118 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd90003520 con 0x7fcda0034b10 2024-05-10T03:53:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7fcda67fc640 1 -- 172.21.15.55:0/3883875118 >> v2:172.21.15.64:3300/0 conn(0x7fcda0048be0 msgr2=0x7fcda0053fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7f39cd2de640 1 Processor -- start 2024-05-10T03:53:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.483+0000 7f39cd2de640 1 -- start start 2024-05-10T03:53:48.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7f604fde4640 1 Processor -- start 2024-05-10T03:53:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.484+0000 7f604fde4640 1 -- start start 2024-05-10T03:53:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f1c860f4640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1c78037fe0 0x7f1c78058420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:39610/0 (socket says 172.21.15.55:39610) 2024-05-10T03:53:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f1c870f6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1c780f00b0 0x7f1c780f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7fcda67fc640 1 --2- 172.21.15.55:0/3883875118 >> v2:172.21.15.64:3300/0 conn(0x7fcda0048be0 0x7fcda0053fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7fcda67fc640 1 -- 172.21.15.55:0/3883875118 >> v1:172.21.15.55:6789/0 conn(0x7fcda0034b10 legacy=0x7fcda000b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f1c860f4640 1 -- 172.21.15.55:0/3378541532 learned_addr learned my addr 172.21.15.55:0/3378541532 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f3553264640 1 Processor -- start 2024-05-10T03:53:48.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3378541532 >> v2:172.21.15.64:3300/0 conn(0x7f1c780f00b0 0x7f1c780f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7fcda67fc640 1 -- 172.21.15.55:0/3883875118 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda0054510 con 0x7fcda0035040 2024-05-10T03:53:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f3553264640 1 -- start start 2024-05-10T03:53:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/3883875118 >> v2:172.21.15.64:3300/0 conn(0x7fcda0048be0 0x7fcda0053fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39cd2de640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c0038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c780e7990 con 0x7f1c7803c100 2024-05-10T03:53:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c780570a0 con 0x7f1c78037fe0 2024-05-10T03:53:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39cd2de640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c00544c0 con 0x7f39c0033ef0 2024-05-10T03:53:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39cd2de640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c00541e0 con 0x7f39c0053c70 2024-05-10T03:53:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39cd2de640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f39c0005f80 con 0x7f39c000c0a0 2024-05-10T03:53:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39ccadd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39c0033ef0 0x7f39c004fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39690/0 (socket says 172.21.15.55:39690) 2024-05-10T03:53:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39ccadd640 1 -- 172.21.15.55:0/1956108100 learned_addr learned my addr 172.21.15.55:0/1956108100 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.485+0000 7f39c7fff640 1 --2- 172.21.15.55:0/1956108100 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c0038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2548469227 0 0) 0x7f1c780e7990 con 0x7f1c7803c100 2024-05-10T03:53:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f1c780383c0 con 0x7f1c780f00b0 2024-05-10T03:53:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c6c003520 con 0x7f1c7803c100 2024-05-10T03:53:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675764326 0 0) 0x7f1c780570a0 con 0x7f1c78037fe0 2024-05-10T03:53:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1e522ef640 1 Processor -- start 2024-05-10T03:53:48.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c780e7990 con 0x7f1c78037fe0 2024-05-10T03:53:48.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f604fde4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6048163610 0x7f604806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f604fde4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 0x7f60480cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f604fde4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60481639f0 con 0x7f604806dbf0 2024-05-10T03:53:48.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f604fde4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f604806e9d0 con 0x7f6048163610 2024-05-10T03:53:48.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f604fde4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f604806e130 con 0x7f60480b5380 2024-05-10T03:53:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f39c7fff640 1 -- 172.21.15.55:0/1956108100 >> v1:172.21.15.64:6789/0 conn(0x7f39c0053c70 legacy=0x7f39c00df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f39c7fff640 1 -- 172.21.15.55:0/1956108100 >> v1:172.21.15.55:6789/0 conn(0x7f39c0033ef0 legacy=0x7f39c004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f39c7fff640 1 -- 172.21.15.55:0/1956108100 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0006260 con 0x7f39c000c0a0 2024-05-10T03:53:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f3243cd1640 1 Processor -- start 2024-05-10T03:53:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f3243cd1640 1 -- start start 2024-05-10T03:53:48.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 554967866 0 0) 0x7f1c780e7990 con 0x7f1c78037fe0 2024-05-10T03:53:48.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1b052d0640 1 Processor -- start 2024-05-10T03:53:48.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1e522ef640 1 -- start start 2024-05-10T03:53:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 >> v2:172.21.15.64:3300/0 conn(0x7f1c780f00b0 msgr2=0x7f1c780f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 --2- 172.21.15.55:0/3378541532 >> v2:172.21.15.64:3300/0 conn(0x7f1c780f00b0 0x7f1c780f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 >> v1:172.21.15.55:6789/0 conn(0x7f1c7803c100 legacy=0x7f1c7803c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78057380 con 0x7f1c78037fe0 2024-05-10T03:53:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.486+0000 7f1b052d0640 1 -- start start 2024-05-10T03:53:48.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3553264640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 0x7f35440572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f604e381640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 0x7f60480cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3553264640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 0x7f354403c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f604e381640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 0x7f60480cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49526/0 (socket says 172.21.15.55:49526) 2024-05-10T03:53:48.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f604e381640 1 -- 172.21.15.55:0/2042707793 learned_addr learned my addr 172.21.15.55:0/2042707793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7fcda67fc640 1 --2- 172.21.15.55:0/3883875118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda0048fc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcda8076b80 tx=0x7fcda80a6370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4281466ce0692bad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.1 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f1c7c0016d0 con 0x7f1c78037fe0 2024-05-10T03:53:48.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 >> v1:172.21.15.64:6789/0 conn(0x7f1c78037fe0 legacy=0x7f1c78058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f604db80640 1 --2- 172.21.15.55:0/2042707793 >> v2:172.21.15.55:3300/0 conn(0x7f6048163610 0x7f604806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6c004c40 0x7f1c6c005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3551000640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 0x7f35440572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3551000640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 0x7f35440572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49528/0 (socket says 172.21.15.55:49528) 2024-05-10T03:53:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3551801640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 0x7f354403c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c0037a0 0x7f1c6c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004160 0x7f1c6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3551801640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 0x7f354403c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56700/0 (socket says 172.21.15.55:56700) 2024-05-10T03:53:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3553264640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35440e36e0 con 0x7f3544053750 2024-05-10T03:53:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3243cd1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f323c15b270 0x7f323c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3553264640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f3544057b40 con 0x7f35440542e0 2024-05-10T03:53:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f39c7fff640 1 --2- 172.21.15.55:0/1956108100 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c0038080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0097d0 tx=0x7f39bc02a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6ed8fb7114d09c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3553264640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3544057e20 con 0x7f35440e3300 2024-05-10T03:53:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f3551000640 1 -- 172.21.15.55:0/3911416447 learned_addr learned my addr 172.21.15.55:0/3911416447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c860f4640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6c004c40 0x7f1c6c005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c00c090 con 0x7f1c6c004160 2024-05-10T03:53:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c00c210 con 0x7f1c6c004c40 2024-05-10T03:53:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6c00c410 con 0x7f1c6c0037a0 2024-05-10T03:53:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f1c858f3640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c0037a0 0x7f1c6c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3241a6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f323c15b270 0x7f323c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3241a6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f323c15b270 0x7f323c0b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56716/0 (socket says 172.21.15.55:56716) 2024-05-10T03:53:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e522ef640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 0x7f1e440e2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f39c6ffd640 1 -- 172.21.15.55:0/1956108100 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc037070 con 0x7f39c000c0a0 2024-05-10T03:53:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f39c6ffd640 1 -- 172.21.15.55:0/1956108100 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc032440 con 0x7f39c000c0a0 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004160 0x7f1c6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f39c6ffd640 1 -- 172.21.15.55:0/1956108100 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc032810 con 0x7f39c000c0a0 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f604e381640 1 -- 172.21.15.55:0/2042707793 >> v2:172.21.15.55:3300/0 conn(0x7f6048163610 msgr2=0x7f604806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.487+0000 7f604e381640 1 --2- 172.21.15.55:0/2042707793 >> v2:172.21.15.55:3300/0 conn(0x7f6048163610 0x7f604806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f604e381640 1 -- 172.21.15.55:0/2042707793 >> v1:172.21.15.55:6789/0 conn(0x7f604806dbf0 legacy=0x7f60480b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f604e381640 1 -- 172.21.15.55:0/2042707793 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604806e410 con 0x7f60480b5380 2024-05-10T03:53:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3241a6d640 1 -- 172.21.15.55:0/2196099608 learned_addr learned my addr 172.21.15.55:0/2196099608 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e522ef640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e44051e80 con 0x7f1e440e3490 2024-05-10T03:53:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e522ef640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e44052160 con 0x7f1e44051690 2024-05-10T03:53:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e522ef640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1e440e2c90 con 0x7f1e44009da0 2024-05-10T03:53:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f354b7fe640 1 -- 172.21.15.55:0/3911416447 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479131493 0 0) 0x7f35440e36e0 con 0x7f3544053750 2024-05-10T03:53:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f354b7fe640 1 -- 172.21.15.55:0/3911416447 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f353c003520 con 0x7f3544053750 2024-05-10T03:53:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2196099608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c06fa40 0x7f323c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1b052d0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af80e7760 0x7f1af80489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1b052d0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1af8007850 con 0x7f1af8048f10 2024-05-10T03:53:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1b052d0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1af8007b30 con 0x7f1af800b0b0 2024-05-10T03:53:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1b052d0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1af80e7b40 con 0x7f1af80e7760 2024-05-10T03:53:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e512ed640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 0x7f1e440e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e512ed640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 0x7f1e440e2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49554/0 (socket says 172.21.15.55:49554) 2024-05-10T03:53:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1e512ed640 1 -- 172.21.15.55:0/486580990 learned_addr learned my addr 172.21.15.55:0/486580990 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c15b650 con 0x7f323c15eda0 2024-05-10T03:53:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f323c15f840 con 0x7f323c15b270 2024-05-10T03:53:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f323c15fb20 con 0x7f323c06fa40 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c860f4640 1 -- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c0037a0 msgr2=0x7f1c6c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c860f4640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c0037a0 0x7f1c6c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c860f4640 1 -- 172.21.15.55:0/3378541532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004160 msgr2=0x7f1c6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c860f4640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004160 0x7f1c6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c860f4640 1 -- 172.21.15.55:0/3378541532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c780e7990 con 0x7f1c6c004c40 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c004160 0x7f1c6c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c868f5640 1 -- 172.21.15.55:0/3378541532 reap_dead start 2024-05-10T03:53:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1c858f3640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c0037a0 0x7f1c6c003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f324226e640 1 --2- 172.21.15.55:0/2196099608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c06fa40 0x7f323c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1aff7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1af8048f10 0x7f1af8053f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39722/0 (socket says 172.21.15.55:39722) 2024-05-10T03:53:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f1aff7fe640 1 -- 172.21.15.55:0/4031850518 learned_addr learned my addr 172.21.15.55:0/4031850518 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3551000640 1 -- 172.21.15.55:0/3911416447 >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 msgr2=0x7f354403c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3551000640 1 --2- 172.21.15.55:0/3911416447 >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 0x7f354403c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3551000640 1 -- 172.21.15.55:0/3911416447 >> v1:172.21.15.64:6789/0 conn(0x7f3544053750 legacy=0x7f3544053bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3551000640 1 -- 172.21.15.55:0/3911416447 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3544058100 con 0x7f35440e3300 2024-05-10T03:53:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7f3551801640 1 --2- 172.21.15.55:0/3911416447 >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 0x7f354403c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afffff640 1 --2- 172.21.15.55:0/4031850518 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af80e7760 0x7f1af80489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 -- 172.21.15.55:0/1956108100 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 msgr2=0x7f39c0038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 --2- 172.21.15.55:0/1956108100 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c0038080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0097d0 tx=0x7f39bc02a160 comp rx=0 tx=0).stop 2024-05-10T03:53:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047359449 0 0) 0x7f1af8007b30 con 0x7f1af800b0b0 2024-05-10T03:53:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af0003520 con 0x7f1af800b0b0 2024-05-10T03:53:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652766257 0 0) 0x7f1af8007850 con 0x7f1af8048f10 2024-05-10T03:53:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1e512ed640 1 -- 172.21.15.55:0/486580990 >> v1:172.21.15.64:6789/0 conn(0x7f1e44051690 legacy=0x7f1e4400a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1e512ed640 1 -- 172.21.15.55:0/486580990 >> v1:172.21.15.55:6789/0 conn(0x7f1e440e3490 legacy=0x7f1e440e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1e512ed640 1 -- 172.21.15.55:0/486580990 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e440e2f70 con 0x7f1e44009da0 2024-05-10T03:53:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af8007b30 con 0x7f1af8048f10 2024-05-10T03:53:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 -- 172.21.15.55:0/1956108100 shutdown_connections 2024-05-10T03:53:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7fcda5ffb640 1 -- 172.21.15.55:0/3883875118 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd980016f0 con 0x7fcda0035040 2024-05-10T03:53:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7fcda5ffb640 1 -- 172.21.15.55:0/3883875118 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda80a6bf0 con 0x7fcda0035040 2024-05-10T03:53:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.488+0000 7fcda5ffb640 1 -- 172.21.15.55:0/3883875118 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda80ae440 con 0x7fcda0035040 2024-05-10T03:53:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 --2- 172.21.15.55:0/1956108100 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c0038080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 -- 172.21.15.55:0/1956108100 >> 172.21.15.55:0/1956108100 conn(0x7f39c0009fb0 msgr2=0x7f39c000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f604e381640 1 --2- 172.21.15.55:0/2042707793 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 0x7f60480cff10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6048071730 tx=0x7f604402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28e57a7b400305cd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7fcda7fff640 1 -- 172.21.15.55:0/3883875118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 msgr2=0x7fcda0048fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7fcda7fff640 1 --2- 172.21.15.55:0/3883875118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda0048fc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcda8076b80 tx=0x7fcda80a6370 comp rx=0 tx=0).stop 2024-05-10T03:53:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f324226e640 1 -- 172.21.15.55:0/2196099608 >> v2:172.21.15.55:3300/0 conn(0x7f323c15b270 msgr2=0x7f323c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f324226e640 1 --2- 172.21.15.55:0/2196099608 >> v2:172.21.15.55:3300/0 conn(0x7f323c15b270 0x7f323c0b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1c860f4640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6c004c40 0x7f1c6c005020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c007fb0 tx=0x7f1c6c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=320bd80706f8bda8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7fcda7fff640 1 -- 172.21.15.55:0/3883875118 shutdown_connections 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7fcda7fff640 1 --2- 172.21.15.55:0/3883875118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda0048fc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7fcda7fff640 1 --2- 172.21.15.55:0/3883875118 >> v2:172.21.15.64:3300/0 conn(0x7fcda0048be0 0x7fcda0053fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7fcda7fff640 1 -- 172.21.15.55:0/3883875118 >> 172.21.15.55:0/3883875118 conn(0x7fcda001ef70 msgr2=0x7fcda0055c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f3551000640 1 --2- 172.21.15.55:0/3911416447 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 0x7f35440572f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f354c06b0a0 tx=0x7f354c0a6590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1012d32c47aec7f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 -- 172.21.15.55:0/1956108100 shutdown_connections 2024-05-10T03:53:48.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f39cd2de640 1 -- 172.21.15.55:0/1956108100 wait complete. 2024-05-10T03:53:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f3240a6b640 1 -- 172.21.15.55:0/2196099608 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387272444 0 0) 0x7f323c15b650 con 0x7f323c15eda0 2024-05-10T03:53:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f324226e640 1 -- 172.21.15.55:0/2196099608 >> v1:172.21.15.55:6789/0 conn(0x7f323c15eda0 legacy=0x7f323c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afffff640 1 -- 172.21.15.55:0/4031850518 >> v1:172.21.15.64:6789/0 conn(0x7f1af800b0b0 legacy=0x7f1af804f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afffff640 1 -- 172.21.15.55:0/4031850518 >> v1:172.21.15.55:6789/0 conn(0x7f1af8048f10 legacy=0x7f1af8053f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f1afffff640 1 -- 172.21.15.55:0/4031850518 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af8053740 con 0x7f1af80e7760 2024-05-10T03:53:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.489+0000 7f324226e640 1 -- 172.21.15.55:0/2196099608 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c0ceb70 con 0x7f323c06fa40 2024-05-10T03:53:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1e512ed640 1 --2- 172.21.15.55:0/486580990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 0x7f1e440e2200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0098a0 tx=0x7f1e3c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82bd8fc1cb5de415 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c007c00 con 0x7f1c6c004c40 2024-05-10T03:53:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f604cb7e640 1 -- 172.21.15.55:0/2042707793 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044037070 con 0x7f60480b5380 2024-05-10T03:53:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f604cb7e640 1 -- 172.21.15.55:0/2042707793 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6044032440 con 0x7f60480b5380 2024-05-10T03:53:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f604cb7e640 1 -- 172.21.15.55:0/2042707793 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044032810 con 0x7f60480b5380 2024-05-10T03:53:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f354b7fe640 1 -- 172.21.15.55:0/3911416447 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c06e610 con 0x7f35440e3300 2024-05-10T03:53:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f354b7fe640 1 -- 172.21.15.55:0/3911416447 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c06e7b0 con 0x7f35440e3300 2024-05-10T03:53:48.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f354b7fe640 1 -- 172.21.15.55:0/3911416447 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c06ec20 con 0x7f35440e3300 2024-05-10T03:53:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0058d0 con 0x7f1c6c004c40 2024-05-10T03:53:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1e43fff640 1 -- 172.21.15.55:0/486580990 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c037070 con 0x7f1e44009da0 2024-05-10T03:53:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1e43fff640 1 -- 172.21.15.55:0/486580990 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c032440 con 0x7f1e44009da0 2024-05-10T03:53:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1e43fff640 1 -- 172.21.15.55:0/486580990 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c032810 con 0x7f1e44009da0 2024-05-10T03:53:48.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7f1c850f2640 1 -- 172.21.15.55:0/3378541532 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c005d00 con 0x7f1c6c004c40 2024-05-10T03:53:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7fcda7fff640 1 -- 172.21.15.55:0/3883875118 shutdown_connections 2024-05-10T03:53:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.490+0000 7fcda7fff640 1 -- 172.21.15.55:0/3883875118 wait complete. 2024-05-10T03:53:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f324226e640 1 --2- 172.21.15.55:0/2196099608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c06fa40 0x7f323c15f230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f323402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc30e75f0c8be066 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f604fde4640 1 -- 172.21.15.55:0/2042707793 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 msgr2=0x7f60480cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f604fde4640 1 --2- 172.21.15.55:0/2042707793 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 0x7f60480cff10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6048071730 tx=0x7f604402a1a0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1afffff640 1 --2- 172.21.15.55:0/4031850518 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af80e7760 0x7f1af80489d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0097d0 tx=0x7f1aec02a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f97fedbc95c9e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3240a6b640 1 -- 172.21.15.55:0/2196099608 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234007740 con 0x7f323c06fa40 2024-05-10T03:53:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3240a6b640 1 -- 172.21.15.55:0/2196099608 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32340078e0 con 0x7f323c06fa40 2024-05-10T03:53:48.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3240a6b640 1 -- 172.21.15.55:0/2196099608 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234007cb0 con 0x7f323c06fa40 2024-05-10T03:53:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f604fde4640 1 -- 172.21.15.55:0/2042707793 shutdown_connections 2024-05-10T03:53:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec037070 con 0x7f1af80e7760 2024-05-10T03:53:48.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f604fde4640 1 --2- 172.21.15.55:0/2042707793 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60480b5380 0x7f60480cff10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1e522ef640 1 -- 172.21.15.55:0/486580990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 msgr2=0x7f1e440e2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1e522ef640 1 --2- 172.21.15.55:0/486580990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 0x7f1e440e2200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0098a0 tx=0x7f1e3c02a250 comp rx=0 tx=0).stop 2024-05-10T03:53:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6c004c40 msgr2=0x7f1c6c005020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1c870f6640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6c004c40 0x7f1c6c005020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c007fb0 tx=0x7f1c6c005830 comp rx=0 tx=0).stop 2024-05-10T03:53:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 -- 172.21.15.55:0/3911416447 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 msgr2=0x7f35440572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 --2- 172.21.15.55:0/3911416447 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 0x7f35440572f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f354c06b0a0 tx=0x7f354c0a6590 comp rx=0 tx=0).stop 2024-05-10T03:53:48.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1e522ef640 1 -- 172.21.15.55:0/486580990 shutdown_connections 2024-05-10T03:53:48.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1e522ef640 1 --2- 172.21.15.55:0/486580990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e44009da0 0x7f1e440e2200 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1e522ef640 1 -- 172.21.15.55:0/486580990 >> 172.21.15.55:0/486580990 conn(0x7f1e440537b0 msgr2=0x7f1e44053b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 -- 172.21.15.55:0/3911416447 shutdown_connections 2024-05-10T03:53:48.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f604fde4640 1 --2- 172.21.15.55:0/2042707793 >> v2:172.21.15.55:3300/0 conn(0x7f6048163610 0x7f604806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 --2- 172.21.15.55:0/3911416447 >> v2:172.21.15.55:3300/0 conn(0x7f35440542e0 0x7f354403c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 --2- 172.21.15.55:0/3911416447 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440e3300 0x7f35440572f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 -- 172.21.15.55:0/3911416447 >> 172.21.15.55:0/3911416447 conn(0x7f3544058ef0 msgr2=0x7f3544059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec032640 con 0x7f1af80e7760 2024-05-10T03:53:48.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1afeffd640 1 -- 172.21.15.55:0/4031850518 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0329f0 con 0x7f1af80e7760 2024-05-10T03:53:48.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f604fde4640 1 -- 172.21.15.55:0/2042707793 >> 172.21.15.55:0/2042707793 conn(0x7f604806c390 msgr2=0x7f604806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f1e522ef640 1 -- 172.21.15.55:0/486580990 shutdown_connections 2024-05-10T03:53:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 -- 172.21.15.55:0/3911416447 shutdown_connections 2024-05-10T03:53:48.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f3553264640 1 -- 172.21.15.55:0/3911416447 wait complete. 2024-05-10T03:53:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.491+0000 7f39cd2de640 1 Processor -- start 2024-05-10T03:53:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1e522ef640 1 -- 172.21.15.55:0/486580990 wait complete. 2024-05-10T03:53:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f604fde4640 1 -- 172.21.15.55:0/2042707793 shutdown_connections 2024-05-10T03:53:48.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f39cd2de640 1 -- start start 2024-05-10T03:53:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f604fde4640 1 -- 172.21.15.55:0/2042707793 wait complete. 2024-05-10T03:53:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c06fa40 msgr2=0x7f323c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2196099608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c06fa40 0x7f323c15f230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f323402a660 comp rx=0 tx=0).stop 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 shutdown_connections 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2196099608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c06fa40 0x7f323c15f230 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2196099608 >> v2:172.21.15.55:3300/0 conn(0x7f323c15b270 0x7f323c0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 >> 172.21.15.55:0/2196099608 conn(0x7f323c0b2b70 msgr2=0x7f323c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7fcda7fff640 1 Processor -- start 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7fcda7fff640 1 -- start start 2024-05-10T03:53:48.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1b052d0640 1 -- 172.21.15.55:0/4031850518 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af80e7760 msgr2=0x7f1af80489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 shutdown_connections 2024-05-10T03:53:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1c870f6640 1 --2- 172.21.15.55:0/3378541532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6c004c40 0x7f1c6c005020 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 >> 172.21.15.55:0/3378541532 conn(0x7f1c78058ef0 msgr2=0x7f1c78059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1b052d0640 1 --2- 172.21.15.55:0/4031850518 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af80e7760 0x7f1af80489d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0097d0 tx=0x7f1aec02a2c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.492+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 shutdown_connections 2024-05-10T03:53:48.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 shutdown_connections 2024-05-10T03:53:48.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f3243cd1640 1 -- 172.21.15.55:0/2196099608 wait complete. 2024-05-10T03:53:48.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39cd2de640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c00e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1b052d0640 1 -- 172.21.15.55:0/4031850518 shutdown_connections 2024-05-10T03:53:48.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1b052d0640 1 --2- 172.21.15.55:0/4031850518 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af80e7760 0x7f1af80489d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1b052d0640 1 -- 172.21.15.55:0/4031850518 >> 172.21.15.55:0/4031850518 conn(0x7f1af800a400 msgr2=0x7f1af800a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39cd2de640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39c0033ef0 0x7f39c00d5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39cd2de640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c0053c70 0x7f39c0178cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39cd2de640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0037a90 con 0x7f39c0053c70 2024-05-10T03:53:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39cd2de640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0037910 con 0x7f39c0033ef0 2024-05-10T03:53:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39cd2de640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f39c00501a0 con 0x7f39c000c0a0 2024-05-10T03:53:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1b052d0640 1 -- 172.21.15.55:0/4031850518 shutdown_connections 2024-05-10T03:53:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39ccadd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c0053c70 0x7f39c0178cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39ccadd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c0053c70 0x7f39c0178cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56728/0 (socket says 172.21.15.55:56728) 2024-05-10T03:53:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f39ccadd640 1 -- 172.21.15.55:0/1321094022 learned_addr learned my addr 172.21.15.55:0/1321094022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1e522ef640 1 Processor -- start 2024-05-10T03:53:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1e522ef640 1 -- start start 2024-05-10T03:53:48.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcda0034b10 0x7fcda00deac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda00e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda0048be0 0x7fcda0049740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda7fff640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcda003b520 con 0x7fcda0048be0 2024-05-10T03:53:48.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda7fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00e7b00 con 0x7fcda0034b10 2024-05-10T03:53:48.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda7fff640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcda003b800 con 0x7fcda0035040 2024-05-10T03:53:48.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f39ccadd640 1 -- 172.21.15.55:0/1321094022 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 msgr2=0x7f39c00e1250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T03:53:48.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f39ccadd640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39c000c0a0 0x7f39c00e1250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f39ccadd640 1 -- 172.21.15.55:0/1321094022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39c0033ef0 msgr2=0x7f39c00d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f39ccadd640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39c0033ef0 0x7f39c00d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f39ccadd640 1 -- 172.21.15.55:0/1321094022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00d3170 con 0x7f39c0053c70 2024-05-10T03:53:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda0048be0 0x7fcda0049740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda0048be0 0x7fcda0049740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56734/0 (socket says 172.21.15.55:56734) 2024-05-10T03:53:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 -- 172.21.15.55:0/451332703 learned_addr learned my addr 172.21.15.55:0/451332703 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f1c870f6640 1 -- 172.21.15.55:0/3378541532 wait complete. 2024-05-10T03:53:48.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f39ccadd640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c0053c70 0x7f39c0178cf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c400 tx=0x7f39b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f3243cd1640 1 Processor -- start 2024-05-10T03:53:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f3553264640 1 Processor -- start 2024-05-10T03:53:48.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f3243cd1640 1 -- start start 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 -- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 msgr2=0x7fcda00e8c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcda0035040 0x7fcda00e8c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 -- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcda0034b10 msgr2=0x7fcda00deac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcda0034b10 0x7fcda00deac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7fcda77fe640 1 -- 172.21.15.55:0/451332703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda00e9170 con 0x7fcda0048be0 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7fcda77fe640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda0048be0 0x7fcda0049740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c700 tx=0x7fcd9800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f3553264640 1 -- start start 2024-05-10T03:53:48.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.493+0000 7f1b052d0640 1 -- 172.21.15.55:0/4031850518 wait complete. 2024-05-10T03:53:48.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f1b052d0640 1 Processor -- start 2024-05-10T03:53:48.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f604fde4640 1 Processor -- start 2024-05-10T03:53:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98017070 con 0x7fcda0048be0 2024-05-10T03:53:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd98005ad0 con 0x7fcda0048be0 2024-05-10T03:53:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98007070 con 0x7fcda0048be0 2024-05-10T03:53:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7fcda7fff640 1 -- 172.21.15.55:0/451332703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda00e9410 con 0x7fcda0048be0 2024-05-10T03:53:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4017070 con 0x7f39c0053c70 2024-05-10T03:53:48.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f1b052d0640 1 -- start start 2024-05-10T03:53:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f1e522ef640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e44009da0 0x7f1e440d4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c00d3450 con 0x7f39c0053c70 2024-05-10T03:53:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c00d3a10 con 0x7f39c0053c70 2024-05-10T03:53:48.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f1e522ef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e44051690 0x7f1e440dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b4005d00 con 0x7f39c0053c70 2024-05-10T03:53:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4007310 con 0x7f39c0053c70 2024-05-10T03:53:48.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7fcda7fff640 1 -- 172.21.15.55:0/451332703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda00e99d0 con 0x7fcda0048be0 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.494+0000 7f604fde4640 1 -- start start 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604fde4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f604806dbf0 0x7f604815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604fde4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60480b5380 0x7f6048165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604fde4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6048163610 0x7f60481664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604db80640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f604806dbf0 0x7f604815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604fde4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6048072890 con 0x7f60480b5380 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604fde4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f60480cf9f0 con 0x7f6048163610 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604fde4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f60480d0450 con 0x7f604806dbf0 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604db80640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f604806dbf0 0x7f604815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49594/0 (socket says 172.21.15.55:49594) 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604db80640 1 -- 172.21.15.55:0/1125317980 learned_addr learned my addr 172.21.15.55:0/1125317980 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604e381640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6048163610 0x7f60481664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f604db80640 1 -- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6048163610 msgr2=0x7f60481664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f604db80640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6048163610 0x7f60481664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f604db80640 1 -- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60480b5380 msgr2=0x7f6048165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f1e522ef640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e440e3490 0x7f1e440ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f1e522ef640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1e440e41b0 con 0x7f1e44051690 2024-05-10T03:53:48.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f3243cd1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f323c06fa40 0x7f323c143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f1e522ef640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1e440e4030 con 0x7f1e44009da0 2024-05-10T03:53:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.496+0000 7f3553264640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3544053750 0x7f354404f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1e522ef640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1e440e4330 con 0x7f1e440e3490 2024-05-10T03:53:48.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3553264640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440542e0 0x7f354403a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1c870f6640 1 Processor -- start 2024-05-10T03:53:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.495+0000 7f604d37f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60480b5380 0x7f6048165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f604db80640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60480b5380 0x7f6048165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3553264640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35440e3300 0x7f3544051fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f604db80640 1 -- 172.21.15.55:0/1125317980 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6048164d90 con 0x7f604806dbf0 2024-05-10T03:53:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1c870f6640 1 -- start start 2024-05-10T03:53:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f604d37f640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60480b5380 0x7f6048165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3241a6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f323c06fa40 0x7f323c143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3241a6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f323c06fa40 0x7f323c143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39450/0 (socket says 172.21.15.55:39450) 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3241a6d640 1 -- 172.21.15.55:0/2832902349 learned_addr learned my addr 172.21.15.55:0/2832902349 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c15b270 0x7f323c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c15eda0 0x7f323c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1e512ed640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e44009da0 0x7f1e440d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1e51aee640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e440e3490 0x7f1e440ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1e51aee640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e440e3490 0x7f1e440ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49610/0 (socket says 172.21.15.55:49610) 2024-05-10T03:53:48.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1e51aee640 1 -- 172.21.15.55:0/3078827956 learned_addr learned my addr 172.21.15.55:0/3078827956 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0d03a0 con 0x7f323c15b270 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f323c0ce860 con 0x7f323c06fa40 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f324226e640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c15eda0 0x7f323c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f324126c640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c15b270 0x7f323c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f323c0d0520 con 0x7f323c15eda0 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1b052d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af800b0b0 0x7f1af8034970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1b052d0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af8048f10 0x7f1af80e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1b052d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1af80e7760 0x7f1af81851c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1b052d0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1af8054650 con 0x7f1af800b0b0 2024-05-10T03:53:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1b052d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1af8053430 con 0x7f1af80e7760 2024-05-10T03:53:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f1b052d0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1af80547d0 con 0x7f1af8048f10 2024-05-10T03:53:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f604db80640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f604806dbf0 0x7f604815d020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6040009d10 tx=0x7f604000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1e512ed640 1 -- 172.21.15.55:0/3078827956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e440e3490 msgr2=0x7f1e440ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39c00052c0 con 0x7f39c0053c70 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3551000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3544053750 0x7f354404f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3551000640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3544053750 0x7f354404f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39438/0 (socket says 172.21.15.55:39438) 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f354bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440542e0 0x7f354403a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f354bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440542e0 0x7f354403a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49618/0 (socket says 172.21.15.55:49618) 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3553264640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3544058be0 con 0x7f35440e3300 2024-05-10T03:53:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3553264640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3544057830 con 0x7f3544053750 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3553264640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f35440de470 con 0x7f35440542e0 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7f3551801640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35440e3300 0x7f3544051fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3551000640 1 -- 172.21.15.55:0/1400085937 learned_addr learned my addr 172.21.15.55:0/1400085937 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1e512ed640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1e440e3490 0x7f1e440ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1e512ed640 1 -- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e44051690 msgr2=0x7f1e440dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1e512ed640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e44051690 0x7f1e440dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1e512ed640 1 -- 172.21.15.55:0/3078827956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4403b5b0 con 0x7f1e44009da0 2024-05-10T03:53:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.497+0000 7fcda7fff640 1 -- 172.21.15.55:0/451332703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd88001030 con 0x7fcda0048be0 2024-05-10T03:53:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1aff7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af8048f10 0x7f1af80e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1c870f6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c004c40 0x7f1c780debd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f1c870f6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c780df8c0 0x7f1c78006d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3551000640 1 -- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440542e0 msgr2=0x7f354403a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3551000640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35440542e0 0x7f354403a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3551000640 1 -- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35440e3300 msgr2=0x7f3544051fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3551000640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35440e3300 0x7f3544051fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f3551000640 1 -- 172.21.15.55:0/1400085937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354403ae00 con 0x7f3544053750 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f324126c640 1 -- 172.21.15.55:0/2832902349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c15eda0 msgr2=0x7f323c1598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f324126c640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f323c15eda0 0x7f323c1598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f324126c640 1 -- 172.21.15.55:0/2832902349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f323c06fa40 msgr2=0x7f323c143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f324126c640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f323c06fa40 0x7f323c143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f324126c640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c15c150 con 0x7f323c15b270 2024-05-10T03:53:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c860f4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c004c40 0x7f1c780debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c860f4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c004c40 0x7f1c780debd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49664/0 (socket says 172.21.15.55:49664) 2024-05-10T03:53:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c860f4640 1 -- 172.21.15.55:0/3750528680 learned_addr learned my addr 172.21.15.55:0/3750528680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1b04acf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1af80e7760 0x7f1af81851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c870f6640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c780df300 0x7f1c780072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1aff7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af8048f10 0x7f1af80e8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49648/0 (socket says 172.21.15.55:49648) 2024-05-10T03:53:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1aff7fe640 1 -- 172.21.15.55:0/872660825 learned_addr learned my addr 172.21.15.55:0/872660825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c780df300 0x7f1c780072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1afffff640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af800b0b0 0x7f1af8034970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c858f3640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c780df8c0 0x7f1c78006d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1e512ed640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e44009da0 0x7f1e440d4210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c031000 tx=0x7f1e3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78057c20 con 0x7f1c780df300 2024-05-10T03:53:48.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78057940 con 0x7f1c780df8c0 2024-05-10T03:53:48.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1c78057f00 con 0x7f1c6c004c40 2024-05-10T03:53:48.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcd9801a070 con 0x7fcda0048be0 2024-05-10T03:53:48.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcd940763a0 0x7fcd94078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcd98096a40 con 0x7fcda0048be0 2024-05-10T03:53:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040018020 con 0x7f604806dbf0 2024-05-10T03:53:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6040014480 con 0x7f604806dbf0 2024-05-10T03:53:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040014830 con 0x7f604806dbf0 2024-05-10T03:53:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7fcd8ffff640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7fcd9407e5c0 0x7fcd940809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 --> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd9801fe50 con 0x7fcd9407e5c0 2024-05-10T03:53:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcd9809b2a0 con 0x7fcda0048be0 2024-05-10T03:53:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6048165070 con 0x7f604806dbf0 2024-05-10T03:53:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.498+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6048165630 con 0x7f604806dbf0 2024-05-10T03:53:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c041020 con 0x7f1e44009da0 2024-05-10T03:53:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c030800 con 0x7f1e44009da0 2024-05-10T03:53:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c037040 con 0x7f1e44009da0 2024-05-10T03:53:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1e522ef640 1 -- 172.21.15.55:0/3078827956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4403b890 con 0x7f1e44009da0 2024-05-10T03:53:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcd940763a0 0x7fcd94078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.499+0000 7f3551000640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3544053750 0x7f354404f3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f354c0519b0 tx=0x7f354c06c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f602bfff640 1 -- 172.21.15.55:0/1125317980 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60480cff10 con 0x7f604806dbf0 2024-05-10T03:53:48.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f39b401a070 con 0x7f39c0053c70 2024-05-10T03:53:48.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f324126c640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c15b270 0x7f323c15b650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c390 tx=0x7f322c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1e522ef640 1 -- 172.21.15.55:0/3078827956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4403be50 con 0x7f1e44009da0 2024-05-10T03:53:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1c858f3640 1 -- 172.21.15.55:0/3750528680 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c004c40 msgr2=0x7f1c780debd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1c858f3640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6c004c40 0x7f1c780debd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1c858f3640 1 -- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c780df300 msgr2=0x7f1c780072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0bc020 con 0x7f3544053750 2024-05-10T03:53:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c0ae9d0 con 0x7f3544053750 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1afffff640 1 -- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af8048f10 msgr2=0x7f1af80e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1afffff640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1af8048f10 0x7f1af80e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1afffff640 1 -- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1af80e7760 msgr2=0x7f1af81851c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1afffff640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1af80e7760 0x7f1af81851c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f1afffff640 1 -- 172.21.15.55:0/872660825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af8034eb0 con 0x7f1af800b0b0 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7fcda67fc640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7fcd9407e5c0 0x7fcd940809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.500+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354403b0e0 con 0x7f3544053750 2024-05-10T03:53:48.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcd940763a0 0x7fcd94078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009a00 tx=0x7fcd9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1c858f3640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c780df300 0x7f1c780072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1afffff640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af800b0b0 0x7f1af8034970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1aec031000 tx=0x7f1aec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1c858f3640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c780df110 con 0x7f1c780df8c0 2024-05-10T03:53:48.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c780df300 0x7f1c780072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:48.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0aed80 con 0x7f3544053750 2024-05-10T03:53:48.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354403b6a0 con 0x7f3544053750 2024-05-10T03:53:48.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c017070 con 0x7f323c15b270 2024-05-10T03:53:48.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f39c4ff9640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f39ac0763a0 0x7f39ac078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec041020 con 0x7f1af800b0b0 2024-05-10T03:53:48.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c0035f0 con 0x7f323c15b270 2024-05-10T03:53:48.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7fcda67fc640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7fcd9407e5c0 0x7fcd940809e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f604001b020 con 0x7f604806dbf0 2024-05-10T03:53:48.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f1e522ef640 1 -- 172.21.15.55:0/3078827956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e44036b50 con 0x7f1e44009da0 2024-05-10T03:53:48.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f1c858f3640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c780df8c0 0x7f1c78006d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c78004100 tx=0x7f1c7000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c700050d0 con 0x7f1c780df8c0 2024-05-10T03:53:48.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70005270 con 0x7f1c780df8c0 2024-05-10T03:53:48.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c0039e0 con 0x7f323c15b270 2024-05-10T03:53:48.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c1552e0 con 0x7f323c15b270 2024-05-10T03:53:48.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c155b80 con 0x7f323c15b270 2024-05-10T03:53:48.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f39c7fff640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f39ac0763a0 0x7f39ac078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3544005710 con 0x7f3544053750 2024-05-10T03:53:48.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e3c044020 con 0x7f1e44009da0 2024-05-10T03:53:48.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f603e7fc640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f602c0763a0 0x7f602c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== osd.4 v2:172.21.15.64:6809/945910103 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd9801fe50 con 0x7fcd9407e5c0 2024-05-10T03:53:48.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70007230 con 0x7f1c780df8c0 2024-05-10T03:53:48.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c78053b50 con 0x7f1c780df8c0 2024-05-10T03:53:48.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c78053590 con 0x7f1c780df8c0 2024-05-10T03:53:48.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.502+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f60400982f0 con 0x7f604806dbf0 2024-05-10T03:53:48.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f323c050740 con 0x7f323c15b270 2024-05-10T03:53:48.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f39c7fff640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f39ac0763a0 0x7f39ac078860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f39bc034000 tx=0x7f39bc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f603e7fc640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f602c07e5c0 0x7f602c0809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 --> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6040013e50 con 0x7f602c07e5c0 2024-05-10T03:53:48.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f604009f050 con 0x7f604806dbf0 2024-05-10T03:53:48.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f604d37f640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f602c0763a0 0x7f602c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f1e41ffb640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1e300763a0 0x7f1e30078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.503+0000 7f604e381640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f602c07e5c0 0x7f602c0809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f39b40969e0 con 0x7f39c0053c70 2024-05-10T03:53:48.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f354c0bf020 con 0x7f3544053750 2024-05-10T03:53:48.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f39c4ff9640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f39ac07e540 0x7f39ac080960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3c0b7d50 con 0x7f1e44009da0 2024-05-10T03:53:48.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f1e41ffb640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7f1e3007e5a0 0x7f1e300809c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 --> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e3c03fe50 con 0x7f1e3007e5a0 2024-05-10T03:53:48.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1e3c07cee0 con 0x7f1e44009da0 2024-05-10T03:53:48.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f604d37f640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f602c0763a0 0x7f602c078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6038007fd0 tx=0x7f6038009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39ac081010 con 0x7f39ac07e540 2024-05-10T03:53:48.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f39b409b2a0 con 0x7f39c0053c70 2024-05-10T03:53:48.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f604e381640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f602c07e5c0 0x7f602c0809e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f39c77fe640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f39ac07e540 0x7f39ac080960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f1e51aee640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7f1e3007e5a0 0x7f1e300809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.504+0000 7f1e50aec640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1e300763a0 0x7f1e30078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f35497fa640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35300763a0 0x7f3530078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f1e51aee640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7f1e3007e5a0 0x7f1e300809c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af8189370 con 0x7f1af800b0b0 2024-05-10T03:53:48.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.501+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af8189c10 con 0x7f1af800b0b0 2024-05-10T03:53:48.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f39c77fe640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f39ac07e540 0x7f39ac080960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== osd.6 v2:172.21.15.64:6824/630497291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6040013e50 con 0x7f602c07e5c0 2024-05-10T03:53:48.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f322c01a070 con 0x7f323c15b270 2024-05-10T03:53:48.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f32327fc640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f32200763a0 0x7f3220078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f3241a6d640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f32200763a0 0x7f3220078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== osd.3 v2:172.21.15.55:6808/600411321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39ac081010 con 0x7f39ac07e540 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f354c134170 con 0x7f3544053750 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f35497fa640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f353007e5c0 0x7f35300809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 --> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f354c0b4e50 con 0x7f353007e5c0 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f354c13b050 con 0x7f3544053750 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aec032640 con 0x7f1af800b0b0 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aec037040 con 0x7f1af800b0b0 2024-05-10T03:53:48.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ae0001030 con 0x7f1af800b0b0 2024-05-10T03:53:48.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f322c0967c0 con 0x7f323c15b270 2024-05-10T03:53:48.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f354bfff640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35300763a0 0x7f3530078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.505+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c780e57e0 con 0x7f1c780df8c0 2024-05-10T03:53:48.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== osd.1 v2:172.21.15.55:6813/141982067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e3c03fe50 con 0x7f1e3007e5a0 2024-05-10T03:53:48.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f3551801640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f353007e5c0 0x7f35300809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c700073d0 con 0x7f1c780df8c0 2024-05-10T03:53:48.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1e50aec640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1e300763a0 0x7f1e30078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e48000f60 tx=0x7f1e480079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f1c76ffd640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1c640763d0 0x7f1c64078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.506+0000 7f32327fc640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f322007e5a0 0x7f32200809c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f322c01be50 con 0x7f322007e5a0 2024-05-10T03:53:48.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f322c09d050 con 0x7f323c15b270 2024-05-10T03:53:48.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c70096ea0 con 0x7f1c780df8c0 2024-05-10T03:53:48.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f324226e640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f322007e5a0 0x7f32200809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1c76ffd640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7f1c6407e5d0 0x7f1c640809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1c860f4640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1c640763d0 0x7f1c64078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7f1c6407e5d0 0x7f1c640809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c70005270 con 0x7f1c6407e5d0 2024-05-10T03:53:48.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f3551801640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f353007e5c0 0x7f35300809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.507+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1c7005c870 con 0x7f1c780df8c0 2024-05-10T03:53:48.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f1c860f4640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1c640763d0 0x7f1c64078890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c007e50 tx=0x7f1c7c02d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f3241a6d640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f32200763a0 0x7f3220078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3238009c90 tx=0x7f3238009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f1c868f5640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7f1c6407e5d0 0x7f1c640809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f354bfff640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35300763a0 0x7f3530078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35440e24b0 tx=0x7f3538009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== osd.5 v2:172.21.15.64:6808/3692026818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f354c0b4e50 con 0x7f353007e5c0 2024-05-10T03:53:48.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f324226e640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f322007e5a0 0x7f32200809c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.509+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== osd.0 v2:172.21.15.55:6824/2785073931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f322c01be50 con 0x7f322007e5a0 2024-05-10T03:53:48.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.509+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== osd.2 v2:172.21.15.55:6800/3097925138 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c70005270 con 0x7f1c6407e5d0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.508+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1aec044020 con 0x7f1af800b0b0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.509+0000 7f1afcff9640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ae40762d0 0x7f1ae4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.510+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1aec0b7c60 con 0x7f1af800b0b0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.510+0000 7f1afcff9640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f1ae407e550 0x7f1ae4080970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.510+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 --> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1aec03fe50 con 0x7f1ae407e550 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.510+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1aec0ba2c0 con 0x7f1af800b0b0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.510+0000 7f1aff7fe640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ae40762d0 0x7f1ae4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.511+0000 7f1aff7fe640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ae40762d0 0x7f1ae4078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1af803adf0 tx=0x7f1af4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.511+0000 7f1b04acf640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f1ae407e550 0x7f1ae4080970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.512+0000 7f1b04acf640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f1ae407e550 0x7f1ae4080970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.513+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== osd.7 v2:172.21.15.64:6800/767106247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1aec03fe50 con 0x7f1ae407e550 2024-05-10T03:53:48.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.533+0000 7fcda7fff640 1 -- 172.21.15.55:0/451332703 --> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd88002dd0 con 0x7fcd9407e5c0 2024-05-10T03:53:48.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.533+0000 7fcd8ffff640 1 -- 172.21.15.55:0/451332703 <== osd.4 v2:172.21.15.64:6809/945910103 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcd88002dd0 con 0x7fcd9407e5c0 2024-05-10T03:53:48.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.534+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7fcd9407e5c0 msgr2=0x7fcd940809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.534+0000 7fcd8dffb640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7fcd9407e5c0 0x7fcd940809e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.534+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcd940763a0 msgr2=0x7fcd94078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.534+0000 7fcd8dffb640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcd940763a0 0x7fcd94078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009a00 tx=0x7fcd9c009190 comp rx=0 tx=0).stop 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda0048be0 msgr2=0x7fcda0049740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcd8dffb640 1 --2- 172.21.15.55:0/451332703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda0048be0 0x7fcda0049740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c700 tx=0x7fcd9800cbc0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcda77fe640 1 -- 172.21.15.55:0/451332703 reap_dead start 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 shutdown_connections 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 >> 172.21.15.55:0/451332703 conn(0x7fcda001ef70 msgr2=0x7fcda0035c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 shutdown_connections 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.535+0000 7fcd8dffb640 1 -- 172.21.15.55:0/451332703 wait complete. 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.540+0000 7f1e522ef640 1 -- 172.21.15.55:0/3078827956 --> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1e44005710 con 0x7f1e3007e5a0 2024-05-10T03:53:48.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.540+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f39c0005990 con 0x7f39ac07e540 2024-05-10T03:53:48.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f1e41ffb640 1 -- 172.21.15.55:0/3078827956 <== osd.1 v2:172.21.15.55:6813/141982067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1e44005710 con 0x7f1e3007e5a0 2024-05-10T03:53:48.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39c4ff9640 1 -- 172.21.15.55:0/1321094022 <== osd.3 v2:172.21.15.55:6808/600411321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f39c0005990 con 0x7f39ac07e540 2024-05-10T03:53:48.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f39ac07e540 msgr2=0x7f39ac080960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39cd2de640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f39ac07e540 0x7f39ac080960 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f602bfff640 1 -- 172.21.15.55:0/1125317980 --> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6048050740 con 0x7f602c07e5c0 2024-05-10T03:53:48.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7f1e3007e5a0 msgr2=0x7f1e300809c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f1e2f7fe640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7f1e3007e5a0 0x7f1e300809c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f39ac0763a0 msgr2=0x7f39ac078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39cd2de640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f39ac0763a0 0x7f39ac078860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f39bc034000 tx=0x7f39bc02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c0053c70 msgr2=0x7f39c0178cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.541+0000 7f39cd2de640 1 --2- 172.21.15.55:0/1321094022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39c0053c70 0x7f39c0178cf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c400 tx=0x7f39b400c8c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f39ccadd640 1 -- 172.21.15.55:0/1321094022 reap_dead start 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 shutdown_connections 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 >> 172.21.15.55:0/1321094022 conn(0x7f39c0009fb0 msgr2=0x7f39c00485f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1e300763a0 msgr2=0x7f1e30078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e2f7fe640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1e300763a0 0x7f1e30078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e48000f60 tx=0x7f1e480079b0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e44009da0 msgr2=0x7f1e440d4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e2f7fe640 1 --2- 172.21.15.55:0/3078827956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e44009da0 0x7f1e440d4210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c031000 tx=0x7f1e3c0046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e51aee640 1 -- 172.21.15.55:0/3078827956 reap_dead start 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 shutdown_connections 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 >> 172.21.15.55:0/3078827956 conn(0x7f1e440537b0 msgr2=0x7f1e440089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f603e7fc640 1 -- 172.21.15.55:0/1125317980 <== osd.6 v2:172.21.15.64:6824/630497291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6048050740 con 0x7f602c07e5c0 2024-05-10T03:53:48.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 shutdown_connections 2024-05-10T03:53:48.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f39cd2de640 1 -- 172.21.15.55:0/1321094022 wait complete. 2024-05-10T03:53:48.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.542+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 --> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35440dce00 con 0x7f353007e5c0 2024-05-10T03:53:48.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f602c07e5c0 msgr2=0x7f602c0809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f602c07e5c0 0x7f602c0809e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 --> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f323c155680 con 0x7f322007e5a0 2024-05-10T03:53:48.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 shutdown_connections 2024-05-10T03:53:48.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f602c0763a0 msgr2=0x7f602c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f1e2f7fe640 1 -- 172.21.15.55:0/3078827956 wait complete. 2024-05-10T03:53:48.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f602c0763a0 0x7f602c078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6038007fd0 tx=0x7f6038009040 comp rx=0 tx=0).stop 2024-05-10T03:53:48.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f604806dbf0 msgr2=0x7f604815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 --2- 172.21.15.55:0/1125317980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f604806dbf0 0x7f604815d020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6040009d10 tx=0x7f604000c490 comp rx=0 tx=0).stop 2024-05-10T03:53:48.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 --> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c78005710 con 0x7f1c6407e5d0 2024-05-10T03:53:48.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604e381640 1 -- 172.21.15.55:0/1125317980 reap_dead start 2024-05-10T03:53:48.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 shutdown_connections 2024-05-10T03:53:48.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 >> 172.21.15.55:0/1125317980 conn(0x7f604806c390 msgr2=0x7f604806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.543+0000 7f32327fc640 1 -- 172.21.15.55:0/2832902349 <== osd.0 v2:172.21.15.55:6824/2785073931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f323c155680 con 0x7f322007e5a0 2024-05-10T03:53:48.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 shutdown_connections 2024-05-10T03:53:48.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f1c76ffd640 1 -- 172.21.15.55:0/3750528680 <== osd.2 v2:172.21.15.55:6800/3097925138 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c78005710 con 0x7f1c6407e5d0 2024-05-10T03:53:48.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f35497fa640 1 -- 172.21.15.55:0/1400085937 <== osd.5 v2:172.21.15.64:6808/3692026818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35440dce00 con 0x7f353007e5c0 2024-05-10T03:53:48.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f604fde4640 1 -- 172.21.15.55:0/1125317980 wait complete. 2024-05-10T03:53:48.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f322007e5a0 msgr2=0x7f32200809c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f322007e5a0 0x7f32200809c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f32200763a0 msgr2=0x7f3220078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7f1c6407e5d0 msgr2=0x7f1c640809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f32200763a0 0x7f3220078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3238009c90 tx=0x7f3238009240 comp rx=0 tx=0).stop 2024-05-10T03:53:48.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f1c870f6640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7f1c6407e5d0 0x7f1c640809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1c640763d0 msgr2=0x7f1c64078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f1c870f6640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1c640763d0 0x7f1c64078890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c007e50 tx=0x7f1c7c02d000 comp rx=0 tx=0).stop 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c780df8c0 msgr2=0x7f1c78006d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f1c870f6640 1 --2- 172.21.15.55:0/3750528680 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c780df8c0 0x7f1c78006d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c78004100 tx=0x7f1c7000ec10 comp rx=0 tx=0).stop 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f1c868f5640 1 -- 172.21.15.55:0/3750528680 reap_dead start 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c15b270 msgr2=0x7f323c15b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.544+0000 7f3243cd1640 1 --2- 172.21.15.55:0/2832902349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c15b270 0x7f323c15b650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f322c00c390 tx=0x7f322c00c850 comp rx=0 tx=0).stop 2024-05-10T03:53:48.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 shutdown_connections 2024-05-10T03:53:48.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f353007e5c0 msgr2=0x7f35300809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 >> 172.21.15.55:0/3750528680 conn(0x7f1c78058ef0 msgr2=0x7f1c7803a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f353007e5c0 0x7f35300809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f324226e640 1 -- 172.21.15.55:0/2832902349 reap_dead start 2024-05-10T03:53:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 shutdown_connections 2024-05-10T03:53:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 >> 172.21.15.55:0/2832902349 conn(0x7f323c0b2b70 msgr2=0x7f323c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 shutdown_connections 2024-05-10T03:53:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35300763a0 msgr2=0x7f3530078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3243cd1640 1 -- 172.21.15.55:0/2832902349 wait complete. 2024-05-10T03:53:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35300763a0 0x7f3530078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35440e24b0 tx=0x7f3538009040 comp rx=0 tx=0).stop 2024-05-10T03:53:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3544053750 msgr2=0x7f354404f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 --2- 172.21.15.55:0/1400085937 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3544053750 0x7f354404f3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f354c0519b0 tx=0x7f354c06c2c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3551801640 1 -- 172.21.15.55:0/1400085937 reap_dead start 2024-05-10T03:53:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 shutdown_connections 2024-05-10T03:53:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 >> 172.21.15.55:0/1400085937 conn(0x7f3544058ef0 msgr2=0x7f354403c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.545+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 --> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ae0002dd0 con 0x7f1ae407e550 2024-05-10T03:53:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.546+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 shutdown_connections 2024-05-10T03:53:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.546+0000 7f1c870f6640 1 -- 172.21.15.55:0/3750528680 wait complete. 2024-05-10T03:53:48.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.546+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 shutdown_connections 2024-05-10T03:53:48.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.546+0000 7f3553264640 1 -- 172.21.15.55:0/1400085937 wait complete. 2024-05-10T03:53:48.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.546+0000 7f1afcff9640 1 -- 172.21.15.55:0/872660825 <== osd.7 v2:172.21.15.64:6800/767106247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ae0002dd0 con 0x7f1ae407e550 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f1ae407e550 msgr2=0x7f1ae4080970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b052d0640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f1ae407e550 0x7f1ae4080970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ae40762d0 msgr2=0x7f1ae4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b052d0640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ae40762d0 0x7f1ae4078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1af803adf0 tx=0x7f1af4009040 comp rx=0 tx=0).stop 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af800b0b0 msgr2=0x7f1af8034970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b052d0640 1 --2- 172.21.15.55:0/872660825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1af800b0b0 0x7f1af8034970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1aec031000 tx=0x7f1aec0046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.547+0000 7f1b04acf640 1 -- 172.21.15.55:0/872660825 reap_dead start 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.548+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 shutdown_connections 2024-05-10T03:53:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.548+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 >> 172.21.15.55:0/872660825 conn(0x7f1af800a400 msgr2=0x7f1af8049320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.548+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 shutdown_connections 2024-05-10T03:53:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.548+0000 7f1b052d0640 1 -- 172.21.15.55:0/872660825 wait complete. 2024-05-10T03:53:48.615 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:48.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T03:53:48.616 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:48.617 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T03:53:48.617 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-05-10T03:53:48.618 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T03:53:48.618 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:48.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T03:53:48.619 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:48.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T03:53:48.620 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:48.621 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T03:53:48.621 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:48.622 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T03:53:48.623 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2024-05-10T03:53:48.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T03:53:48.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.834+0000 7f41e0de5640 1 Processor -- start 2024-05-10T03:53:48.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.834+0000 7fb01b30a640 1 Processor -- start 2024-05-10T03:53:48.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.834+0000 7f0fd91f2640 1 Processor -- start 2024-05-10T03:53:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.834+0000 7f41e0de5640 1 -- start start 2024-05-10T03:53:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.834+0000 7f0fd91f2640 1 -- start start 2024-05-10T03:53:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.835+0000 7fb01b30a640 1 -- start start 2024-05-10T03:53:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.835+0000 7efeac207640 1 Processor -- start 2024-05-10T03:53:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f41da59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f41dc09e3e0 0x7f41dc06cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39728/0 (socket says 172.21.15.55:39728) 2024-05-10T03:53:48.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f41da59c640 1 -- 172.21.15.55:0/3811987639 learned_addr learned my addr 172.21.15.55:0/3811987639 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f41e0de5640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41dc0b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7fb01b30a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 0x7fb01406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7fb0188a5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb01406e600 0x7fb0140b6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39732/0 (socket says 172.21.15.55:39732) 2024-05-10T03:53:48.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.835+0000 7f06ece46640 1 Processor -- start 2024-05-10T03:53:48.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.835+0000 7f06ece46640 1 -- start start 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd91f2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd91f2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fcc053700 0x7f0fcc050a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd89f1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fcc053700 0x7f0fcc050a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd91f2640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc053b00 con 0x7f0fcc0e0420 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd91f2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f0fcc03a330 con 0x7f0fcc053700 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd89f1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fcc053700 0x7f0fcc050a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56810/0 (socket says 172.21.15.55:56810) 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd89f1640 1 -- 172.21.15.55:0/951761780 learned_addr learned my addr 172.21.15.55:0/951761780 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.836+0000 7f0fd91f2640 1 -- 172.21.15.55:0/951761780 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc0516b0 con 0x7f0fcc0e0040 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.835+0000 7efeac207640 1 -- start start 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeac207640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efea414d110 0x7efea4168080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeac207640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea40d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeac207640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efea406c390 0x7efea406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeac207640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7efea40cd530 con 0x7efea406c390 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeac207640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7efea406ccd0 con 0x7efea414d110 2024-05-10T03:53:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7fb0190a6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 0x7fb01406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeac207640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efea40ccf90 con 0x7efea40cc7a0 2024-05-10T03:53:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06ece46640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06e00e7610 0x7f06e0050570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06ece46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 0x7f06e0053510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7fb0190a6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 0x7fb01406eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49668/0 (socket says 172.21.15.55:49668) 2024-05-10T03:53:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7fb0188a5640 1 -- 172.21.15.55:0/1509288648 learned_addr learned my addr 172.21.15.55:0/1509288648 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f61d5421640 1 Processor -- start 2024-05-10T03:53:48.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7fc10d989640 1 Processor -- start 2024-05-10T03:53:48.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f61d5421640 1 -- start start 2024-05-10T03:53:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efea97a2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea40d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06ece46640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e0034ab0 con 0x7f06e0034600 2024-05-10T03:53:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06ece46640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f06e0050c50 con 0x7f06e00e7610 2024-05-10T03:53:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06ece46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f06e0050f30 con 0x7f06e00069d0 2024-05-10T03:53:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efea97a2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea40d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49696/0 (socket says 172.21.15.55:49696) 2024-05-10T03:53:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f41dad9d640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41dc0b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efea9fa3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efea414d110 0x7efea4168080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 0x7f06e0053510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 0x7f06e0053510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49708/0 (socket says 172.21.15.55:49708) 2024-05-10T03:53:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 -- 172.21.15.55:0/134721117 learned_addr learned my addr 172.21.15.55:0/134721117 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e659c640 1 --2- 172.21.15.55:0/134721117 >> v2:172.21.15.55:3300/0 conn(0x7f06e00e7610 0x7f06e0050570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efea9fa3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efea414d110 0x7efea4168080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39492/0 (socket says 172.21.15.55:39492) 2024-05-10T03:53:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41dc0b8810 con 0x7f41dc09e3e0 2024-05-10T03:53:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efea9fa3640 1 -- 172.21.15.55:0/4195114927 learned_addr learned my addr 172.21.15.55:0/4195114927 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41dc0742b0 con 0x7f41dc09e7c0 2024-05-10T03:53:48.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc0b97f0 con 0x7f41dc06d3f0 2024-05-10T03:53:48.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 -- 172.21.15.55:0/134721117 >> v2:172.21.15.55:3300/0 conn(0x7f06e00e7610 msgr2=0x7f06e0050570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 --2- 172.21.15.55:0/134721117 >> v2:172.21.15.55:3300/0 conn(0x7f06e00e7610 0x7f06e0050570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 -- 172.21.15.55:0/134721117 >> v1:172.21.15.55:6789/0 conn(0x7f06e0034600 legacy=0x7f06e00062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7f06e6d9d640 1 -- 172.21.15.55:0/134721117 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e0051210 con 0x7f06e00069d0 2024-05-10T03:53:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efeaa7a4640 1 --2- 172.21.15.55:0/4195114927 >> v2:172.21.15.55:3300/0 conn(0x7efea406c390 0x7efea406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7efea9fa3640 1 -- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 msgr2=0x7efea40d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.837+0000 7fc10d989640 1 -- start start 2024-05-10T03:53:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7efea9fa3640 1 --2- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea40d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7efea9fa3640 1 -- 172.21.15.55:0/4195114927 >> v2:172.21.15.55:3300/0 conn(0x7efea406c390 msgr2=0x7efea406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7fb01b30a640 1 --2- 172.21.15.55:0/1509288648 >> v2:172.21.15.55:3300/0 conn(0x7fb0140b7480 0x7fb0140d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0140b4610 con 0x7fb01406e600 2024-05-10T03:53:48.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fb014163f90 con 0x7fb0140b7480 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb01406d1f0 con 0x7fb014163bb0 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7efea9fa3640 1 --2- 172.21.15.55:0/4195114927 >> v2:172.21.15.55:3300/0 conn(0x7efea406c390 0x7efea406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7efea9fa3640 1 -- 172.21.15.55:0/4195114927 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea40cd250 con 0x7efea414d110 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f0fd3fff640 1 --2- 172.21.15.55:0/951761780 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f0fd89f1640 1 -- 172.21.15.55:0/951761780 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 msgr2=0x7f0fcc0531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f0fd89f1640 1 --2- 172.21.15.55:0/951761780 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f0fd89f1640 1 -- 172.21.15.55:0/951761780 >> v1:172.21.15.64:6789/0 conn(0x7f0fcc0e0420 legacy=0x7f0fcc006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f0fd89f1640 1 -- 172.21.15.55:0/951761780 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc051990 con 0x7f0fcc053700 2024-05-10T03:53:48.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f06e6d9d640 1 --2- 172.21.15.55:0/134721117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 0x7f06e0053510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06e8063f70 tx=0x7f06e80a65e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4929a6def66fab1b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7fc10d989640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 0x7fc108073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f61d5421640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61c80e32f0 0x7f61c80572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279260449 0 0) 0x7f41dc0b8810 con 0x7f41dc09e3e0 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c4003520 con 0x7f41dc09e3e0 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3643040473 0 0) 0x7f41dc0742b0 con 0x7f41dc09e7c0 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41dc0b8810 con 0x7f41dc09e7c0 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 757466256 0 0) 0x7f41c4003520 con 0x7f41dc09e3e0 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 msgr2=0x7f41dc0b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41dc0b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 >> v1:172.21.15.64:6789/0 conn(0x7f41dc09e7c0 legacy=0x7f41dc0d36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc074590 con 0x7f41dc09e3e0 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f41cc0016f0 con 0x7f41dc09e3e0 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 >> v1:172.21.15.55:6789/0 conn(0x7f41dc09e3e0 legacy=0x7f41dc06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41c4003cb0 0x7f41c40040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c4004800 0x7f41c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0b97f0 con 0x7f41c4003cb0 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f41c4005570 con 0x7f41c4004800 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f41c400bf00 con 0x7f41dc06d3f0 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc10d989640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1081423d0 con 0x7fc1080ce090 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc10d989640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1081426b0 con 0x7fc108073850 2024-05-10T03:53:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc10d989640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc108073cb0 con 0x7fc108160770 2024-05-10T03:53:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc1067fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 0x7fc108073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc1067fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 0x7fc108073310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49718/0 (socket says 172.21.15.55:49718) 2024-05-10T03:53:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc1067fc640 1 -- 172.21.15.55:0/3912930990 learned_addr learned my addr 172.21.15.55:0/3912930990 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f41dad9d640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f06e559a640 1 -- 172.21.15.55:0/134721117 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e806e410 con 0x7f06e00069d0 2024-05-10T03:53:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f06e559a640 1 -- 172.21.15.55:0/134721117 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e806e5b0 con 0x7f06e00069d0 2024-05-10T03:53:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f06e559a640 1 -- 172.21.15.55:0/134721117 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e806ea20 con 0x7f06e00069d0 2024-05-10T03:53:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f7e024d0640 1 Processor -- start 2024-05-10T03:53:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f7e024d0640 1 -- start start 2024-05-10T03:53:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fb007fff640 1 -- 172.21.15.55:0/1509288648 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220909943 0 0) 0x7fb010001110 con 0x7fb01406e600 2024-05-10T03:53:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7efeaa7a4640 1 --2- 172.21.15.55:0/4195114927 >> v2:172.21.15.55:3300/0 conn(0x7efea406c390 0x7efea406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fb0198a7640 1 --2- 172.21.15.55:0/1509288648 >> v2:172.21.15.55:3300/0 conn(0x7fb0140b7480 0x7fb0140d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f61d5421640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8053bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f61d5421640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c80e36d0 con 0x7f61c8054100 2024-05-10T03:53:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f61d5421640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f61c8054550 con 0x7f61c80e32f0 2024-05-10T03:53:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.838+0000 7f61d5421640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f61c8057b30 con 0x7f61c8053740 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f61d4c20640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f61c8054100 0x7f61c80061e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:39664/0 (socket says 172.21.15.55:39664) 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f61d4c20640 1 -- 172.21.15.55:0/2079720914 learned_addr learned my addr 172.21.15.55:0/2079720914 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f61cf7fe640 1 --2- 172.21.15.55:0/2079720914 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8053bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f41dad9d640 1 -- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c4004800 msgr2=0x7f41c4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f41dad9d640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c4004800 0x7f41c4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f41dad9d640 1 -- 172.21.15.55:0/3811987639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41c4003cb0 msgr2=0x7f41c40040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f41dad9d640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41c4003cb0 0x7f41c40040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f41dad9d640 1 -- 172.21.15.55:0/3811987639 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4003520 con 0x7f41dc06d3f0 2024-05-10T03:53:48.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fb007fff640 1 -- 172.21.15.55:0/1509288648 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb000003520 con 0x7fb01406e600 2024-05-10T03:53:48.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc1067fc640 1 -- 172.21.15.55:0/3912930990 >> v1:172.21.15.64:6789/0 conn(0x7fc108073850 legacy=0x7fc108070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7fc1067fc640 1 -- 172.21.15.55:0/3912930990 >> v1:172.21.15.55:6789/0 conn(0x7fc1080ce090 legacy=0x7fc108141930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:53:48.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f0fd89f1640 1 --2- 172.21.15.55:0/951761780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 0x7f0fcc050a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4063f70 tx=0x7f0fd40aaa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175b46b1758f9d6b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7efea9fa3640 1 --2- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea4168080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efea40ce920 tx=0x7efe9c02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a072f4e53868ef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7fb0190a6640 1 -- 172.21.15.55:0/1509288648 >> v2:172.21.15.55:3300/0 conn(0x7fb0140b7480 msgr2=0x7fb0140d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7fb0190a6640 1 --2- 172.21.15.55:0/1509288648 >> v2:172.21.15.55:3300/0 conn(0x7fb0140b7480 0x7fb0140d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7fb0190a6640 1 -- 172.21.15.55:0/1509288648 >> v1:172.21.15.55:6789/0 conn(0x7fb01406e600 legacy=0x7fb0140b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7fb0190a6640 1 -- 172.21.15.55:0/1509288648 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01406d4d0 con 0x7fb014163bb0 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f0fd2ffd640 1 -- 172.21.15.55:0/951761780 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40ae620 con 0x7f0fcc053700 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 -- 172.21.15.55:0/134721117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 msgr2=0x7f06e0053510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 --2- 172.21.15.55:0/134721117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 0x7f06e0053510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f06e8063f70 tx=0x7f06e80a65e0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 -- 172.21.15.55:0/134721117 shutdown_connections 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 --2- 172.21.15.55:0/134721117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00069d0 0x7f06e0053510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 --2- 172.21.15.55:0/134721117 >> v2:172.21.15.55:3300/0 conn(0x7f06e00e7610 0x7f06e0050570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 -- 172.21.15.55:0/134721117 >> 172.21.15.55:0/134721117 conn(0x7f06e0055380 msgr2=0x7f06e0055790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.839+0000 7f61ceffd640 1 -- 172.21.15.55:0/2079720914 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492734121 0 0) 0x7f61c80e36d0 con 0x7f61c8054100 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f61ceffd640 1 -- 172.21.15.55:0/2079720914 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c0003520 con 0x7f61c8054100 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2079720914 >> v2:172.21.15.55:3300/0 conn(0x7f61c80e32f0 msgr2=0x7f61c80572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f61cf7fe640 1 --2- 172.21.15.55:0/2079720914 >> v2:172.21.15.55:3300/0 conn(0x7f61c80e32f0 0x7f61c80572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2079720914 >> v1:172.21.15.64:6789/0 conn(0x7f61c8054100 legacy=0x7f61c80061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f0fd2ffd640 1 -- 172.21.15.55:0/951761780 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd40ae7c0 con 0x7f0fcc053700 2024-05-10T03:53:48.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f0fd2ffd640 1 -- 172.21.15.55:0/951761780 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40aec30 con 0x7f0fcc053700 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e024d0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7dfc0b5dd0 0x7f7dfc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e024d0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dfc0b72b0 0x7f7dfc15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e024d0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dfc06f4b0 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e024d0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc0b66f0 con 0x7f7dfc0b72b0 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e024d0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc15eaf0 con 0x7f7dfc0b5dd0 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 -- 172.21.15.55:0/134721117 shutdown_connections 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f06ece46640 1 -- 172.21.15.55:0/134721117 wait complete. 2024-05-10T03:53:48.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7efea8fa1640 1 -- 172.21.15.55:0/4195114927 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c036070 con 0x7efea414d110 2024-05-10T03:53:48.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e00ccd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dfc0b72b0 0x7f7dfc15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e00ccd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7dfc0b72b0 0x7f7dfc15fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56872/0 (socket says 172.21.15.55:56872) 2024-05-10T03:53:48.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f7e00ccd640 1 -- 172.21.15.55:0/2954725361 learned_addr learned my addr 172.21.15.55:0/2954725361 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7efea8fa1640 1 -- 172.21.15.55:0/4195114927 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9c031600 con 0x7efea414d110 2024-05-10T03:53:48.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f41dad9d640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41c400b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f41dc06a720 tx=0x7f41c4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7697e328016221 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7fc1067fc640 1 -- 172.21.15.55:0/3912930990 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10815ff70 con 0x7fc108160770 2024-05-10T03:53:48.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4033070 con 0x7f41dc06d3f0 2024-05-10T03:53:48.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d402f650 con 0x7f41dc06d3f0 2024-05-10T03:53:48.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f41d959a640 1 -- 172.21.15.55:0/3811987639 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4009be0 con 0x7f41dc06d3f0 2024-05-10T03:53:48.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fc1067fc640 1 --2- 172.21.15.55:0/3912930990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 0x7fc108073310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0098a0 tx=0x7fc0fc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eddad9ac3ea9b5d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f7e014ce640 1 --2- 172.21.15.55:0/2954725361 >> v2:172.21.15.64:3300/0 conn(0x7f7dfc0b5dd0 0x7f7dfc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f7e00ccd640 1 -- 172.21.15.55:0/2954725361 >> v2:172.21.15.64:3300/0 conn(0x7f7dfc0b5dd0 msgr2=0x7f7dfc0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f7e00ccd640 1 --2- 172.21.15.55:0/2954725361 >> v2:172.21.15.64:3300/0 conn(0x7f7dfc0b5dd0 0x7f7dfc0b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f7e00ccd640 1 -- 172.21.15.55:0/2954725361 >> v1:172.21.15.64:6789/0 conn(0x7f7dfc0d39e0 legacy=0x7f7dfc1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:48.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f7e00ccd640 1 -- 172.21.15.55:0/2954725361 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc15edd0 con 0x7f7dfc0b72b0 2024-05-10T03:53:48.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fb0190a6640 1 --2- 172.21.15.55:0/1509288648 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 0x7fb01406eb50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0080097a0 tx=0x7fb00802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b1c5815174b5e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7f7e014ce640 1 --2- 172.21.15.55:0/2954725361 >> v2:172.21.15.64:3300/0 conn(0x7f7dfc0b5dd0 0x7f7dfc0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:48.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7efeac207640 1 -- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 msgr2=0x7efea4168080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7efeac207640 1 --2- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea4168080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efea40ce920 tx=0x7efe9c02a6c0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 msgr2=0x7f41c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41e0de5640 1 --2- 172.21.15.55:0/3811987639 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc06d3f0 0x7f41c400b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f41dc06a720 tx=0x7f41c4005830 comp rx=0 tx=0).stop 2024-05-10T03:53:48.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41dad9d640 1 -- 172.21.15.55:0/3811987639 reap_dead start 2024-05-10T03:53:48.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fc105ffb640 1 -- 172.21.15.55:0/3912930990 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc037070 con 0x7fc108160770 2024-05-10T03:53:48.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fc105ffb640 1 -- 172.21.15.55:0/3912930990 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc032440 con 0x7fc108160770 2024-05-10T03:53:48.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fc105ffb640 1 -- 172.21.15.55:0/3912930990 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc032810 con 0x7fc108160770 2024-05-10T03:53:48.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fb007fff640 1 -- 172.21.15.55:0/1509288648 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008037070 con 0x7fb014163bb0 2024-05-10T03:53:48.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.841+0000 7fb007fff640 1 -- 172.21.15.55:0/1509288648 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb008032440 con 0x7fb014163bb0 2024-05-10T03:53:48.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fb007fff640 1 -- 172.21.15.55:0/1509288648 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008032810 con 0x7fb014163bb0 2024-05-10T03:53:48.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.840+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2079720914 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c8057e10 con 0x7f61c8053740 2024-05-10T03:53:48.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f61cf7fe640 1 --2- 172.21.15.55:0/2079720914 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8053bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0097a0 tx=0x7f61bc02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee8db487788e12f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f61ceffd640 1 -- 172.21.15.55:0/2079720914 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc037070 con 0x7f61c8053740 2024-05-10T03:53:48.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f7e00ccd640 1 --2- 172.21.15.55:0/2954725361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 0x7f7dfc15fb90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc072e40 tx=0x7f7df402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7d8705646448b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 shutdown_connections 2024-05-10T03:53:48.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 >> 172.21.15.55:0/3811987639 conn(0x7f41dc0d5110 msgr2=0x7f41dc0d5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 -- 172.21.15.55:0/3912930990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 msgr2=0x7fc108073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 --2- 172.21.15.55:0/3912930990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 0x7fc108073310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0098a0 tx=0x7fc0fc02a1a0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f61ceffd640 1 -- 172.21.15.55:0/2079720914 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc032440 con 0x7f61c8053740 2024-05-10T03:53:48.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 shutdown_connections 2024-05-10T03:53:48.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 -- 172.21.15.55:0/3912930990 shutdown_connections 2024-05-10T03:53:48.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 --2- 172.21.15.55:0/3912930990 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108160770 0x7fc108073310 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 -- 172.21.15.55:0/3912930990 >> 172.21.15.55:0/3912930990 conn(0x7fc1080d1f40 msgr2=0x7fc1080d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f41e0de5640 1 -- 172.21.15.55:0/3811987639 wait complete. 2024-05-10T03:53:48.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 -- 172.21.15.55:0/3912930990 shutdown_connections 2024-05-10T03:53:48.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f61ceffd640 1 -- 172.21.15.55:0/2079720914 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc02ae60 con 0x7f61c8053740 2024-05-10T03:53:48.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f06ece46640 1 Processor -- start 2024-05-10T03:53:48.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f06ece46640 1 -- start start 2024-05-10T03:53:48.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 msgr2=0x7fb01406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 --2- 172.21.15.55:0/1509288648 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 0x7fb01406eb50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0080097a0 tx=0x7fb00802a180 comp rx=0 tx=0).stop 2024-05-10T03:53:48.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f7df3fff640 1 -- 172.21.15.55:0/2954725361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4036070 con 0x7f7dfc0b72b0 2024-05-10T03:53:48.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f0fd91f2640 1 -- 172.21.15.55:0/951761780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 msgr2=0x7f0fcc050a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/951761780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 0x7f0fcc050a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4063f70 tx=0x7f0fd40aaa70 comp rx=0 tx=0).stop 2024-05-10T03:53:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f7df3fff640 1 -- 172.21.15.55:0/2954725361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df4031600 con 0x7f7dfc0b72b0 2024-05-10T03:53:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7f7df3fff640 1 -- 172.21.15.55:0/2954725361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40319d0 con 0x7f7dfc0b72b0 2024-05-10T03:53:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 -- 172.21.15.55:0/2079720914 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 msgr2=0x7f61c8053bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 --2- 172.21.15.55:0/2079720914 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8053bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0097a0 tx=0x7f61bc02a110 comp rx=0 tx=0).stop 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 shutdown_connections 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 --2- 172.21.15.55:0/1509288648 >> v2:172.21.15.55:3300/0 conn(0x7fb0140b7480 0x7fb0140d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 --2- 172.21.15.55:0/1509288648 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb014163bb0 0x7fb01406eb50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 >> 172.21.15.55:0/1509288648 conn(0x7fb0140d1d70 msgr2=0x7fb0140d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f0fd91f2640 1 -- 172.21.15.55:0/951761780 shutdown_connections 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/951761780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 0x7f0fcc050a40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 -- 172.21.15.55:0/2079720914 shutdown_connections 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 --2- 172.21.15.55:0/2079720914 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8053bc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 --2- 172.21.15.55:0/2079720914 >> v2:172.21.15.55:3300/0 conn(0x7f61c80e32f0 0x7f61c80572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 -- 172.21.15.55:0/2079720914 >> 172.21.15.55:0/2079720914 conn(0x7f61c8058ee0 msgr2=0x7f61c80592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 -- 172.21.15.55:0/4195114927 shutdown_connections 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 --2- 172.21.15.55:0/4195114927 >> v2:172.21.15.55:3300/0 conn(0x7efea406c390 0x7efea406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 --2- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea40d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 --2- 172.21.15.55:0/4195114927 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea4168080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 -- 172.21.15.55:0/4195114927 >> 172.21.15.55:0/4195114927 conn(0x7efea40d1f40 msgr2=0x7efea40d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/951761780 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f0fd91f2640 1 -- 172.21.15.55:0/951761780 >> 172.21.15.55:0/951761780 conn(0x7f0fcc01e6b0 msgr2=0x7f0fcc0553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 -- 172.21.15.55:0/2079720914 shutdown_connections 2024-05-10T03:53:48.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7f61d5421640 1 -- 172.21.15.55:0/2079720914 wait complete. 2024-05-10T03:53:48.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 -- 172.21.15.55:0/4195114927 shutdown_connections 2024-05-10T03:53:48.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7efeac207640 1 -- 172.21.15.55:0/4195114927 wait complete. 2024-05-10T03:53:48.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.843+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 shutdown_connections 2024-05-10T03:53:48.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f0fd91f2640 1 -- 172.21.15.55:0/951761780 shutdown_connections 2024-05-10T03:53:48.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f06ece46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 0x7f06e0044b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f0fd91f2640 1 -- 172.21.15.55:0/951761780 wait complete. 2024-05-10T03:53:48.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.842+0000 7fc10d989640 1 -- 172.21.15.55:0/3912930990 wait complete. 2024-05-10T03:53:48.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7fc10d989640 1 Processor -- start 2024-05-10T03:53:48.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f06e659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 0x7f06e0044b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f7e024d0640 1 -- 172.21.15.55:0/2954725361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 msgr2=0x7f7dfc15fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f7e024d0640 1 --2- 172.21.15.55:0/2954725361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 0x7f7dfc15fb90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc072e40 tx=0x7f7df402a610 comp rx=0 tx=0).stop 2024-05-10T03:53:48.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7f06e659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 0x7f06e0044b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56884/0 (socket says 172.21.15.55:56884) 2024-05-10T03:53:48.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7fb01b30a640 1 -- 172.21.15.55:0/1509288648 wait complete. 2024-05-10T03:53:48.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.844+0000 7fc10d989640 1 -- start start 2024-05-10T03:53:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06e659c640 1 -- 172.21.15.55:0/465599947 learned_addr learned my addr 172.21.15.55:0/465599947 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06ece46640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06e0034600 0x7f06e017de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f61d5421640 1 Processor -- start 2024-05-10T03:53:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06ece46640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00e7610 0x7f06e0045c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f61d5421640 1 -- start start 2024-05-10T03:53:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06ece46640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0053a50 con 0x7f06e00069d0 2024-05-10T03:53:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06e5d9b640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06e0034600 0x7f06e017de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f41e0de5640 1 Processor -- start 2024-05-10T03:53:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06ece46640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0052ff0 con 0x7f06e0034600 2024-05-10T03:53:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06e6d9d640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00e7610 0x7f06e0045c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f06ece46640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f06e0053bd0 con 0x7f06e00e7610 2024-05-10T03:53:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7f41e0de5640 1 -- start start 2024-05-10T03:53:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fc10d989640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 0x7fc10813e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7efeac207640 1 Processor -- start 2024-05-10T03:53:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fc10d989640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1080ce090 0x7fc10815e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f7e024d0640 1 -- 172.21.15.55:0/2954725361 shutdown_connections 2024-05-10T03:53:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f7e024d0640 1 --2- 172.21.15.55:0/2954725361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 0x7f7dfc15fb90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f7e024d0640 1 --2- 172.21.15.55:0/2954725361 >> v2:172.21.15.64:3300/0 conn(0x7f7dfc0b5dd0 0x7f7dfc0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f7e024d0640 1 -- 172.21.15.55:0/2954725361 >> 172.21.15.55:0/2954725361 conn(0x7f7dfc0d2ec0 msgr2=0x7f7dfc0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f7e024d0640 1 -- 172.21.15.55:0/2954725361 shutdown_connections 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f7e024d0640 1 -- 172.21.15.55:0/2954725361 wait complete. 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7fb01b30a640 1 Processor -- start 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.845+0000 7fb01b30a640 1 -- start start 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb01b30a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb01406e600 0x7fb014201f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb01b30a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 0x7fb0140ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb01b30a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb014163bb0 0x7fb0141f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb01b30a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb01406dd70 con 0x7fb014163bb0 2024-05-10T03:53:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb01b30a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb01406da90 con 0x7fb0140b7480 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb01b30a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb01406e290 con 0x7fb01406e600 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7efeac207640 1 -- start start 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb0188a5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 0x7fb0140ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb0188a5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 0x7fb0140ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39518/0 (socket says 172.21.15.55:39518) 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb0188a5640 1 -- 172.21.15.55:0/3535048965 learned_addr learned my addr 172.21.15.55:0/3535048965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb0198a7640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb014163bb0 0x7fb0141f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fb0190a6640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb01406e600 0x7fb014201f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f06e659c640 1 -- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00e7610 msgr2=0x7f06e0045c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f06e659c640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00e7610 0x7f06e0045c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f06e659c640 1 -- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06e0034600 msgr2=0x7f06e017de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f06e659c640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06e0034600 0x7f06e017de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f06e659c640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e017e3d0 con 0x7f06e00069d0 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f06e659c640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 0x7f06e0044b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ebe0 tx=0x7f06d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f0fd91f2640 1 Processor -- start 2024-05-10T03:53:48.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7f0fd91f2640 1 -- start start 2024-05-10T03:53:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61d5421640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8051970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61d5421640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 0x7f61c8051eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41e0de5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc06d3f0 0x7f41dc1fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41e0de5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 0x7f41dc0a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61d5421640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61c80e32f0 0x7f61c80523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61cf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 0x7f61c8051eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41e0de5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc0a29a0 0x7f41dc073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61cf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 0x7f61c8051eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39526/0 (socket says 172.21.15.55:39526) 2024-05-10T03:53:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41e0de5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0b8d90 con 0x7f41dc1f9b20 2024-05-10T03:53:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 0x7f41dc0a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61cffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8051970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 0x7f41dc0a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56920/0 (socket says 172.21.15.55:56920) 2024-05-10T03:53:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41d9d9b640 1 -- 172.21.15.55:0/268943191 learned_addr learned my addr 172.21.15.55:0/268943191 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fc106ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 0x7fc10813e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.846+0000 7fc106ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 0x7fc10813e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49746/0 (socket says 172.21.15.55:49746) 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 -- 172.21.15.55:0/2965756023 learned_addr learned my addr 172.21.15.55:0/2965756023 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc108160770 0x7fc10813f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc074870 con 0x7f41dc06d3f0 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc108160bd0 con 0x7fc1080ce090 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc10815fd20 con 0x7fc108160770 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc108142040 con 0x7fc108073850 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc1067fc640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1080ce090 0x7fc10815e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 -- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc108160770 msgr2=0x7fc10813f3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:53:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc108160770 0x7fc10813f3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 -- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1080ce090 msgr2=0x7fc10815e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1080ce090 0x7fc10815e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10813fdf0 con 0x7fc108073850 2024-05-10T03:53:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc0b4090 con 0x7f41dc0a29a0 2024-05-10T03:53:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fc106ffd640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 0x7fc10813e910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c7c0 tx=0x7fc10000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0188a5640 1 -- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb01406e600 msgr2=0x7fb014201f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0188a5640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb01406e600 0x7fb014201f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0188a5640 1 -- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb014163bb0 msgr2=0x7fb0141f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0188a5640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb014163bb0 0x7fb0141f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0188a5640 1 -- 172.21.15.55:0/3535048965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0140ca7a0 con 0x7fb0140b7480 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0190a6640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb01406e600 0x7fb014201f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7fb0188a5640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 0x7fb0140ca260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c700 tx=0x7fb01000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.847+0000 7f61cffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8051970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49770/0 (socket says 172.21.15.55:49770) 2024-05-10T03:53:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010017070 con 0x7fb0140b7480 2024-05-10T03:53:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb010005ab0 con 0x7fb0140b7480 2024-05-10T03:53:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61d5421640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f61c8057820 con 0x7f61c80e32f0 2024-05-10T03:53:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61d5421640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80583d0 con 0x7f61c8054100 2024-05-10T03:53:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61d5421640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f61c803d120 con 0x7f61c8053740 2024-05-10T03:53:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2071546820 learned_addr learned my addr 172.21.15.55:0/2071546820 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeac207640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efea406c390 0x7efea4073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61d4c20640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61c80e32f0 0x7f61c80523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010005e60 con 0x7fb0140b7480 2024-05-10T03:53:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fb01b30a640 1 -- 172.21.15.55:0/3535048965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb014202590 con 0x7fb0140b7480 2024-05-10T03:53:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeac207640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea4073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f7e024d0640 1 Processor -- start 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f7e024d0640 1 -- start start 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f7e024d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dfc0b5dd0 0x7f7dfc0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f7e024d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 0x7f7dfc0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f7e024d0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7dfc0d39e0 0x7f7dfc0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f7e024d0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc15f670 con 0x7f7dfc0b72b0 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f7e024d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc15f390 con 0x7f7dfc0b5dd0 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f7e024d0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc074a10 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeac207640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efea97a2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea4073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efea97a2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea4073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49784/0 (socket says 172.21.15.55:49784) 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeaa7a4640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efea97a2640 1 -- 172.21.15.55:0/3853041646 learned_addr learned my addr 172.21.15.55:0/3853041646 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7efea40d1230 con 0x7efea406c390 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efea40d07d0 con 0x7efea414d110 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efea41fa1e0 con 0x7efea40cc7a0 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7efeaa7a4640 1 -- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 msgr2=0x7efea4073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7efeaa7a4640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea4073750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7efeaa7a4640 1 -- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efea406c390 msgr2=0x7efea4073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7efeaa7a4640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efea406c390 0x7efea4073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7efeaa7a4640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea4148bf0 con 0x7efea414d110 2024-05-10T03:53:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f41d9d9b640 1 -- 172.21.15.55:0/268943191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc0a29a0 msgr2=0x7f41dc073190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f41d9d9b640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc0a29a0 0x7f41dc073190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f41d9d9b640 1 -- 172.21.15.55:0/268943191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc06d3f0 msgr2=0x7f41dc1fc7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f41d9d9b640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc06d3f0 0x7f41dc1fc7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f41d9d9b640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc073ec0 con 0x7f41dc1f9b20 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f41d9d9b640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 0x7f41dc0a2460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c730 tx=0x7f41d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d00052d0 con 0x7f41dc1f9b20 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d0005490 con 0x7f41dc1f9b20 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000a880 con 0x7f41dc1f9b20 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100016020 con 0x7fc108073850 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10000aa50 con 0x7fc108073850 2024-05-10T03:53:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10000ae20 con 0x7fc108073850 2024-05-10T03:53:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1081400d0 con 0x7fc108073850 2024-05-10T03:53:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10815e440 con 0x7fc108073850 2024-05-10T03:53:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7fb01b30a640 1 -- 172.21.15.55:0/3535048965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb014202b50 con 0x7fb0140b7480 2024-05-10T03:53:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8017070 con 0x7f06e00069d0 2024-05-10T03:53:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f06ece46640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e0047fd0 con 0x7f06e00069d0 2024-05-10T03:53:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f06ece46640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e0044350 con 0x7f06e00069d0 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd91f2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 0x7f0fcc0223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd91f2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd91f2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc0e0420 0x7f0fcc1783c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd91f2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc006820 con 0x7f0fcc053700 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd91f2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc006540 con 0x7f0fcc0e0420 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd91f2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc050f80 con 0x7f0fcc0e0040 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd37fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd37fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49800/0 (socket says 172.21.15.55:49800) 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f0fd37fe640 1 -- 172.21.15.55:0/253746212 learned_addr learned my addr 172.21.15.55:0/253746212 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f0fd89f1640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc0e0420 0x7f0fcc1783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 msgr2=0x7f61c8051970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61cf7fe640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8051970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61c80e32f0 msgr2=0x7f61c80523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61cf7fe640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61c80e32f0 0x7f61c80523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.848+0000 7f61cf7fe640 1 -- 172.21.15.55:0/2071546820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80e61e0 con 0x7f61c8054100 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f61cf7fe640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 0x7f61c8051eb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61bc02a150 tx=0x7f61bc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc037050 con 0x7f61c8054100 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc043070 con 0x7f61c8054100 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0044e0 con 0x7f61c8054100 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.849+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c8050bb0 con 0x7f61c8054100 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c8051170 con 0x7f61c8054100 2024-05-10T03:53:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06cc005290 con 0x7f06e00069d0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f7e01ccf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7dfc0d39e0 0x7f7dfc0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f7e014ce640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dfc0b5dd0 0x7f7dfc0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f7e014ce640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dfc0b5dd0 0x7f7dfc0b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39566/0 (socket says 172.21.15.55:39566) 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f7e014ce640 1 -- 172.21.15.55:0/133489808 learned_addr learned my addr 172.21.15.55:0/133489808 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f7e01ccf640 1 -- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dfc0b5dd0 msgr2=0x7f7dfc0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f7e01ccf640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dfc0b5dd0 0x7f7dfc0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f7e01ccf640 1 -- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 msgr2=0x7f7dfc0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f7e01ccf640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 0x7f7dfc0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f7e01ccf640 1 -- 172.21.15.55:0/133489808 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc0b2750 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f7e01ccf640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7dfc0d39e0 0x7f7dfc0b3c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b440 tx=0x7f7df800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8015020 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc0d2260 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc0d2540 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df8011830 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.853+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8011c20 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7efeaa7a4640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea40b5d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c540 tx=0x7efe9400ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94015070 con 0x7efea414d110 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe94011800 con 0x7efea414d110 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94015070 con 0x7efea414d110 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea41f9b90 con 0x7efea414d110 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41f9840 con 0x7efea414d110 2024-05-10T03:53:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc0741a0 con 0x7f41dc1f9b20 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc09fa10 con 0x7f41dc1f9b20 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc0a2da0 con 0x7f41dc1f9b20 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7fb01b30a640 1 -- 172.21.15.55:0/3535048965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01406a7e0 con 0x7fb0140b7480 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb01001a070 con 0x7fb0140b7480 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7fb005ffb640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faff80763a0 0x7faff8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb010096890 con 0x7fb0140b7480 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f0fd37fe640 1 -- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc0e0420 msgr2=0x7f0fcc1783c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc0e0420 0x7f0fcc1783c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f0fd37fe640 1 -- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 msgr2=0x7f0fcc0223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 0x7f0fcc0223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.850+0000 7f0fd37fe640 1 -- 172.21.15.55:0/253746212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc020020 con 0x7f0fcc0e0040 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0228e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c450 tx=0x7f0fc000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00052d0 con 0x7f0fcc0e0040 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0005470 con 0x7f0fcc0e0040 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.853+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc00052d0 con 0x7f0fcc0e0040 2024-05-10T03:53:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c8000ec0 con 0x7f61c8054100 2024-05-10T03:53:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d800ecd0 con 0x7f06e00069d0 2024-05-10T03:53:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.851+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d800ee80 con 0x7f06e00069d0 2024-05-10T03:53:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.853+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f61bc032a50 con 0x7f61c8054100 2024-05-10T03:53:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8c005290 con 0x7efea414d110 2024-05-10T03:53:48.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f61ccff9640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f61b40762d0 0x7f61b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61bc0b8300 con 0x7f61c8054100 2024-05-10T03:53:48.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.852+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc100019020 con 0x7fc108073850 2024-05-10T03:53:48.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.853+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10806a7e0 con 0x7fc108073850 2024-05-10T03:53:48.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc005290 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc020300 con 0x7f0fcc0e0040 2024-05-10T03:53:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fcc0208c0 con 0x7f0fcc0e0040 2024-05-10T03:53:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7fb0190a6640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faff80763a0 0x7faff8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7df8018020 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.854+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f41d000aa20 con 0x7f41dc1f9b20 2024-05-10T03:53:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efe94018070 con 0x7efea414d110 2024-05-10T03:53:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7f61cffff640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f61b40762d0 0x7f61b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06d801a070 con 0x7f06e00069d0 2024-05-10T03:53:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7f41caffd640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f41bc0763d0 0x7f41bc078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41d00971f0 con 0x7f41dc1f9b20 2024-05-10T03:53:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fcc005700 con 0x7f0fcc0e0040 2024-05-10T03:53:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7f7df1ffb640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7de0076320 0x7f7de00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.855+0000 7fc0effff640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc0f40763a0 0x7fc0f4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7f06deffd640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f06c80763a0 0x7f06c8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7f41da59c640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f41bc0763d0 0x7f41bc078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7df80973d0 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7efe9a7fc640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe880766d0 0x7efe88078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe94011600 con 0x7efea414d110 2024-05-10T03:53:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7fc1067fc640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc0f40763a0 0x7fc0f4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7f06e5d9b640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f06c80763a0 0x7f06c8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7f7e014ce640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7de0076320 0x7f7de00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06d8097380 con 0x7f06e00069d0 2024-05-10T03:53:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1000972f0 con 0x7fc108073850 2024-05-10T03:53:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.856+0000 7fb0190a6640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faff80763a0 0x7faff8078860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb008034000 tx=0x7fb00802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7f61cffff640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f61b40762d0 0x7f61b4078790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f61c40098e0 tx=0x7f61c4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7efea9fa3640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe880766d0 0x7efe88078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7f7e014ce640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7de0076320 0x7f7de00787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc071080 tx=0x7f7dec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fc0007030 con 0x7f0fcc0e0040 2024-05-10T03:53:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7f41da59c640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f41bc0763d0 0x7f41bc078890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0078d0 tx=0x7f41cc0015a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7fc1067fc640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc0f40763a0 0x7fc0f4078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc034000 tx=0x7fc0fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7f06e5d9b640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f06c80763a0 0x7f06c8078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06e00e6d20 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7efea9fa3640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe880766d0 0x7efe88078b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe9c033000 tx=0x7efe9c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0140b4610 con 0x7fb0140b7480 2024-05-10T03:53:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.857+0000 7f0fd0ff9640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0fb80766d0 0x7f0fb8078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.858+0000 7f0fd3fff640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0fb80766d0 0x7f0fb8078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.858+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fc00050d0 con 0x7f0fcc0e0040 2024-05-10T03:53:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.858+0000 7f0fd3fff640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0fb80766d0 0x7f0fb8078b90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b240 tx=0x7f0fc8006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.860+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7df801f020 con 0x7f7dfc0d39e0 2024-05-10T03:53:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.861+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f41d0060bc0 con 0x7f41dc1f9b20 2024-05-10T03:53:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.862+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f61c8000ec0 con 0x7f61c8054100 2024-05-10T03:53:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.865+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc100020070 con 0x7fc108073850 2024-05-10T03:53:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.866+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06d8060700 con 0x7f06e00069d0 2024-05-10T03:53:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.867+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efe94060000 con 0x7efea414d110 2024-05-10T03:53:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:48.871+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0fc0020020 con 0x7f0fcc0e0040 2024-05-10T03:53:49.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.302+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f61c8005700 con 0x7f61c8054100 2024-05-10T03:53:49.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.302+0000 7f61ccff9640 1 -- 172.21.15.55:0/2071546820 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61bc081bc0 con 0x7f61c8054100 2024-05-10T03:53:49.305 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-05-10T03:53:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.304+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7ddc005580 con 0x7f7dfc0d39e0 2024-05-10T03:53:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.304+0000 7f7df1ffb640 1 -- 172.21.15.55:0/133489808 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7df8060d10 con 0x7f7dfc0d39e0 2024-05-10T03:53:49.307 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.306+0000 7fb01b30a640 1 -- 172.21.15.55:0/3535048965 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb0140b9980 con 0x7fb0140b7480 2024-05-10T03:53:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.306+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f61b40762d0 msgr2=0x7f61b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.306+0000 7f61d5421640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f61b40762d0 0x7f61b4078790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f61c40098e0 tx=0x7f61c4009060 comp rx=0 tx=0).stop 2024-05-10T03:53:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.306+0000 7fb005ffb640 1 -- 172.21.15.55:0/3535048965 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb01005fb80 con 0x7fb0140b7480 2024-05-10T03:53:49.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.306+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 msgr2=0x7f61c8051eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.309 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.306+0000 7f61d5421640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 0x7f61c8051eb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61bc02a150 tx=0x7f61bc0046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 shutdown_connections 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f61b40762d0 0x7f61b4078790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61c80e32f0 0x7f61c80523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61c8054100 0x7f61c8051eb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 --2- 172.21.15.55:0/2071546820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61c8053740 0x7f61c8051970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 >> 172.21.15.55:0/2071546820 conn(0x7f61c8058ee0 msgr2=0x7f61c803a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 shutdown_connections 2024-05-10T03:53:49.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.307+0000 7f61d5421640 1 -- 172.21.15.55:0/2071546820 wait complete. 2024-05-10T03:53:49.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.308+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7de0076320 msgr2=0x7f7de00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.308+0000 7f7e024d0640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7de0076320 0x7f7de00787e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc071080 tx=0x7f7dec008040 comp rx=0 tx=0).stop 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.308+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7dfc0d39e0 msgr2=0x7f7dfc0b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.308+0000 7f7e024d0640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7dfc0d39e0 0x7f7dfc0b3c70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b440 tx=0x7f7df800b900 comp rx=0 tx=0).stop 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.308+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 shutdown_connections 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7dfc0d39e0 0x7f7dfc0b3c70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7de0076320 0x7f7de00787e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc0b72b0 0x7f7dfc0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 --2- 172.21.15.55:0/133489808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7dfc0b5dd0 0x7f7dfc0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 >> 172.21.15.55:0/133489808 conn(0x7f7dfc0d2ec0 msgr2=0x7f7dfc070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 shutdown_connections 2024-05-10T03:53:49.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.309+0000 7f7e024d0640 1 -- 172.21.15.55:0/133489808 wait complete. 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.310+0000 7fafff7fe640 1 -- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faff80763a0 msgr2=0x7faff8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.310+0000 7fafff7fe640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faff80763a0 0x7faff8078860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb008034000 tx=0x7fb00802e000 comp rx=0 tx=0).stop 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.310+0000 7fafff7fe640 1 -- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 msgr2=0x7fb0140ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.310+0000 7fafff7fe640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 0x7fb0140ca260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c700 tx=0x7fb01000cbc0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 -- 172.21.15.55:0/3535048965 shutdown_connections 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faff80763a0 0x7faff8078860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb014163bb0 0x7fb0141f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0140b7480 0x7fb0140ca260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 --2- 172.21.15.55:0/3535048965 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb01406e600 0x7fb014201f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 -- 172.21.15.55:0/3535048965 >> 172.21.15.55:0/3535048965 conn(0x7fb0140d1d70 msgr2=0x7fb0140b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 -- 172.21.15.55:0/3535048965 shutdown_connections 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.311+0000 7fafff7fe640 1 -- 172.21.15.55:0/3535048965 wait complete. 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.312+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc1080746c0 con 0x7fc108073850 2024-05-10T03:53:49.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.312+0000 7fc0effff640 1 -- 172.21.15.55:0/2965756023 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc100060cc0 con 0x7fc108073850 2024-05-10T03:53:49.316 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:49.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.313+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f41dc050740 con 0x7f41dc1f9b20 2024-05-10T03:53:49.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.314+0000 7f41caffd640 1 -- 172.21.15.55:0/268943191 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41d00604c0 con 0x7f41dc1f9b20 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stdout:55834574852 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc0f40763a0 msgr2=0x7fc0f4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc0f40763a0 0x7fc0f4078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc034000 tx=0x7fc0fc02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 msgr2=0x7fc10813e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 0x7fc10813e910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c7c0 tx=0x7fc10000cc80 comp rx=0 tx=0).stop 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 shutdown_connections 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc108160770 0x7fc10813f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc0f40763a0 0x7fc0f4078860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0fcc008220 con 0x7f0fcc0e0040 2024-05-10T03:53:49.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1080ce090 0x7fc10815e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 --2- 172.21.15.55:0/2965756023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc108073850 0x7fc10813e910 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 >> 172.21.15.55:0/2965756023 conn(0x7fc1080d1f40 msgr2=0x7fc108159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f41bc0763d0 msgr2=0x7f41bc078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7f0fd0ff9640 1 -- 172.21.15.55:0/253746212 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0fc0060b50 con 0x7f0fcc0e0040 2024-05-10T03:53:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 shutdown_connections 2024-05-10T03:53:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7fc10d989640 1 -- 172.21.15.55:0/2965756023 wait complete. 2024-05-10T03:53:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7f41e0de5640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f41bc0763d0 0x7f41bc078890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0078d0 tx=0x7f41cc0015a0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 msgr2=0x7f41dc0a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.323 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:49.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.317+0000 7f41e0de5640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 0x7f41dc0a2460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f41d000c730 tx=0x7f41d000cbf0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.318+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 shutdown_connections 2024-05-10T03:53:49.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.318+0000 7f41e0de5640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41dc0a29a0 0x7f41dc073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.318+0000 7f41e0de5640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f41bc0763d0 0x7f41bc078890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.318+0000 7f41e0de5640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41dc1f9b20 0x7f41dc0a2460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.318+0000 7f41e0de5640 1 --2- 172.21.15.55:0/268943191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc06d3f0 0x7f41dc1fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.318+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 >> 172.21.15.55:0/268943191 conn(0x7f41dc0d5110 msgr2=0x7f41dc0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.319+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 shutdown_connections 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.319+0000 7f41e0de5640 1 -- 172.21.15.55:0/268943191 wait complete. 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.320+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f06cc005580 con 0x7f06e00069d0 2024-05-10T03:53:49.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.321+0000 7f06deffd640 1 -- 172.21.15.55:0/465599947 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06d8064a00 con 0x7f06e00069d0 2024-05-10T03:53:49.325 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f06c80763a0 msgr2=0x7f06c8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f06c80763a0 0x7f06c8078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06e00e6d20 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2024-05-10T03:53:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 msgr2=0x7f06e0044b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 0x7f06e0044b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ebe0 tx=0x7f06d800c520 comp rx=0 tx=0).stop 2024-05-10T03:53:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 shutdown_connections 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06e00e7610 0x7f06e0045c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06e0034600 0x7f06e017de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f06c80763a0 0x7f06c8078860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 --2- 172.21.15.55:0/465599947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06e00069d0 0x7f06e0044b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.324+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 >> 172.21.15.55:0/465599947 conn(0x7f06e0055380 msgr2=0x7f06e004a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.325+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 shutdown_connections 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.325+0000 7f06dcff9640 1 -- 172.21.15.55:0/465599947 wait complete. 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.322+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0fb80766d0 msgr2=0x7f0fb8078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0fb80766d0 0x7f0fb8078b90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800b240 tx=0x7f0fc8006a20 comp rx=0 tx=0).stop 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 msgr2=0x7f0fcc0228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0228e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c450 tx=0x7f0fc000c910 comp rx=0 tx=0).stop 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 shutdown_connections 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0fcc0e0420 0x7f0fcc1783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0fcc0e0040 0x7f0fcc0228e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0fb80766d0 0x7f0fb8078b90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 --2- 172.21.15.55:0/253746212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fcc053700 0x7f0fcc0223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 >> 172.21.15.55:0/253746212 conn(0x7f0fcc01e6b0 msgr2=0x7f0fcc04aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 shutdown_connections 2024-05-10T03:53:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.323+0000 7f0fd91f2640 1 -- 172.21.15.55:0/253746212 wait complete. 2024-05-10T03:53:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.325+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efe8c005580 con 0x7efea414d110 2024-05-10T03:53:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.328+0000 7efe9a7fc640 1 -- 172.21.15.55:0/3853041646 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe94064300 con 0x7efea414d110 2024-05-10T03:53:49.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2024-05-10T03:53:49.333 INFO:teuthology.orchestra.run.smithi055.stdout:55834574851 2024-05-10T03:53:49.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.332+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe880766d0 msgr2=0x7efe88078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.332+0000 7efeac207640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe880766d0 0x7efe88078b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe9c033000 tx=0x7efe9c02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.332+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 msgr2=0x7efea40b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.332+0000 7efeac207640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea40b5d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c540 tx=0x7efe9400ca00 comp rx=0 tx=0).stop 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 shutdown_connections 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efea414d110 0x7efea40b5d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efea40cc7a0 0x7efea4073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efe880766d0 0x7efe88078b90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 --2- 172.21.15.55:0/3853041646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efea406c390 0x7efea4073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 >> 172.21.15.55:0/3853041646 conn(0x7efea40d1f40 msgr2=0x7efea4162eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 shutdown_connections 2024-05-10T03:53:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:49.333+0000 7efeac207640 1 -- 172.21.15.55:0/3853041646 wait complete. 2024-05-10T03:53:49.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2024-05-10T03:53:49.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2024-05-10T03:53:49.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2024-05-10T03:53:49.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.6 2024-05-10T03:53:49.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-05-10T03:53:49.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2024-05-10T03:53:50.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T03:53:50.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T03:53:50.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T03:53:50.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T03:53:50.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T03:53:50.347 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T03:53:50.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T03:53:50.351 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T03:53:50.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.501+0000 7f46c0d7f640 1 Processor -- start 2024-05-10T03:53:50.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.502+0000 7f46c0d7f640 1 -- start start 2024-05-10T03:53:50.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.503+0000 7f3742ddd640 1 Processor -- start 2024-05-10T03:53:50.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.503+0000 7f3742ddd640 1 -- start start 2024-05-10T03:53:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46c0d7f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46bc148b00 0x7f46bc163a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46c0d7f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46bc0b5270 con 0x7f46bc15f8c0 2024-05-10T03:53:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46c0d7f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46bc1600f0 con 0x7f46bc06f6a0 2024-05-10T03:53:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46c0d7f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f46bc0729a0 con 0x7f46bc148b00 2024-05-10T03:53:50.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46ba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46bc148b00 0x7f46bc163a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46ba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46bc148b00 0x7f46bc163a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56970/0 (socket says 172.21.15.55:56970) 2024-05-10T03:53:50.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.504+0000 7f46ba59c640 1 -- 172.21.15.55:0/234793910 learned_addr learned my addr 172.21.15.55:0/234793910 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f46ba59c640 1 -- 172.21.15.55:0/234793910 >> v1:172.21.15.64:6789/0 conn(0x7f46bc06f6a0 legacy=0x7f46bc0b5a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:53:50.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f46ba59c640 1 -- 172.21.15.55:0/234793910 >> v1:172.21.15.55:6789/0 conn(0x7f46bc15f8c0 legacy=0x7f46bc072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f3742ddd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f373c0ce090 0x7f373c160770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f3742ddd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f373c073a20 0x7f373c141d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f3740b79640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f373c0ce090 0x7f373c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f3740b79640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f373c0ce090 0x7f373c160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56972/0 (socket says 172.21.15.55:56972) 2024-05-10T03:53:50.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.505+0000 7f373bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f373c141930 0x7f373c073310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39770/0 (socket says 172.21.15.55:39770) 2024-05-10T03:53:50.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f3742ddd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373c1423d0 con 0x7f373c141930 2024-05-10T03:53:50.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f46b959a640 1 -- 172.21.15.55:0/234793910 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745895716 0 0) 0x7f46b0001110 con 0x7f46bc15f8c0 2024-05-10T03:53:50.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f3740b79640 1 -- 172.21.15.55:0/2368905521 learned_addr learned my addr 172.21.15.55:0/2368905521 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f373c15fd20 con 0x7f373c0ce090 2024-05-10T03:53:50.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f373c160cb0 con 0x7f373c073a20 2024-05-10T03:53:50.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f3740b79640 1 -- 172.21.15.55:0/2368905521 >> v2:172.21.15.64:3300/0 conn(0x7f373c073a20 msgr2=0x7f373c141d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T03:53:50.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f3740b79640 1 --2- 172.21.15.55:0/2368905521 >> v2:172.21.15.64:3300/0 conn(0x7f373c073a20 0x7f373c141d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.507+0000 7f3740b79640 1 -- 172.21.15.55:0/2368905521 >> v1:172.21.15.55:6789/0 conn(0x7f373c141930 legacy=0x7f373c073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.506+0000 7f46ba59c640 1 -- 172.21.15.55:0/234793910 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc1603d0 con 0x7f46bc148b00 2024-05-10T03:53:50.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.507+0000 7f46ba59c640 1 --2- 172.21.15.55:0/234793910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc148b00 0x7f46bc163a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009870 tx=0x7f46ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86effe7dd09c1ebb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.507+0000 7f3740b79640 1 -- 172.21.15.55:0/2368905521 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373c1426b0 con 0x7f373c0ce090 2024-05-10T03:53:50.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.507+0000 7f373b7fe640 1 -- 172.21.15.55:0/2368905521 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396087934 0 0) 0x7f373c1423d0 con 0x7f373c141930 2024-05-10T03:53:50.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.508+0000 7f46b959a640 1 -- 172.21.15.55:0/234793910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac037070 con 0x7f46bc148b00 2024-05-10T03:53:50.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.508+0000 7f46b959a640 1 -- 172.21.15.55:0/234793910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ac032440 con 0x7f46bc148b00 2024-05-10T03:53:50.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.508+0000 7f46b959a640 1 -- 172.21.15.55:0/234793910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac032810 con 0x7f46bc148b00 2024-05-10T03:53:50.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.508+0000 7f3740b79640 1 --2- 172.21.15.55:0/2368905521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c0ce090 0x7f373c160770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f373c15fea0 tx=0x7f373002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d04bddd5088a08a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f373b7fe640 1 -- 172.21.15.55:0/2368905521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730037070 con 0x7f373c0ce090 2024-05-10T03:53:50.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f373b7fe640 1 -- 172.21.15.55:0/2368905521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3730032440 con 0x7f373c0ce090 2024-05-10T03:53:50.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f46c0d7f640 1 -- 172.21.15.55:0/234793910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc148b00 msgr2=0x7f46bc163a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/234793910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc148b00 0x7f46bc163a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009870 tx=0x7f46ac02a270 comp rx=0 tx=0).stop 2024-05-10T03:53:50.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f46c0d7f640 1 -- 172.21.15.55:0/234793910 shutdown_connections 2024-05-10T03:53:50.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/234793910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc148b00 0x7f46bc163a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f46c0d7f640 1 -- 172.21.15.55:0/234793910 >> 172.21.15.55:0/234793910 conn(0x7f46bc06e400 msgr2=0x7f46bc06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f46c0d7f640 1 -- 172.21.15.55:0/234793910 shutdown_connections 2024-05-10T03:53:50.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.509+0000 7f373b7fe640 1 -- 172.21.15.55:0/2368905521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730032810 con 0x7f373c0ce090 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.510+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c0ce090 msgr2=0x7f373c160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.510+0000 7f3742ddd640 1 --2- 172.21.15.55:0/2368905521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c0ce090 0x7f373c160770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f373c15fea0 tx=0x7f373002a210 comp rx=0 tx=0).stop 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.510+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 shutdown_connections 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.510+0000 7f3742ddd640 1 --2- 172.21.15.55:0/2368905521 >> v2:172.21.15.64:3300/0 conn(0x7f373c073a20 0x7f373c141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.510+0000 7f3742ddd640 1 --2- 172.21.15.55:0/2368905521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c0ce090 0x7f373c160770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.511+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 >> 172.21.15.55:0/2368905521 conn(0x7f373c0d1f40 msgr2=0x7f373c0d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.510+0000 7f46c0d7f640 1 -- 172.21.15.55:0/234793910 wait complete. 2024-05-10T03:53:50.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.511+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 shutdown_connections 2024-05-10T03:53:50.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.512+0000 7f46c0d7f640 1 Processor -- start 2024-05-10T03:53:50.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.512+0000 7f46c0d7f640 1 -- start start 2024-05-10T03:53:50.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.511+0000 7f3742ddd640 1 -- 172.21.15.55:0/2368905521 wait complete. 2024-05-10T03:53:50.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.513+0000 7f3742ddd640 1 Processor -- start 2024-05-10T03:53:50.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.514+0000 7f46c0d7f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc06f6a0 0x7f46bc15e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.514+0000 7f46ba59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc06f6a0 0x7f46bc15e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.514+0000 7f46ba59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc06f6a0 0x7f46bc15e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56978/0 (socket says 172.21.15.55:56978) 2024-05-10T03:53:50.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.514+0000 7f46ba59c640 1 -- 172.21.15.55:0/1560842603 learned_addr learned my addr 172.21.15.55:0/1560842603 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.514+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46bc148b00 0x7f46bc1403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46bc15f8c0 0x7f46bc1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0b54f0 con 0x7f46bc06f6a0 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.513+0000 7f3742ddd640 1 -- start start 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3742ddd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 0x7f373c205fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3742ddd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f373c0ce090 0x7f373c201760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3742ddd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f373c141930 0x7f373c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3742ddd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f373c145520 con 0x7f373c073a20 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3742ddd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f373c160250 con 0x7f373c0ce090 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3742ddd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f373c1456a0 con 0x7f373c141930 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3740b79640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 0x7f373c205fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3740b79640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 0x7f373c205fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56986/0 (socket says 172.21.15.55:56986) 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f3740b79640 1 -- 172.21.15.55:0/2959561176 learned_addr learned my addr 172.21.15.55:0/2959561176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f3740b79640 1 -- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f373c141930 msgr2=0x7f373c15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f46bad9d640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46bc15f8c0 0x7f46bc1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f46b9d9b640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46bc148b00 0x7f46bc1403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.515+0000 7f374137a640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f373c141930 0x7f373c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f3740b79640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f373c141930 0x7f373c15e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f3740b79640 1 -- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f373c0ce090 msgr2=0x7f373c201760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f3740b79640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f373c0ce090 0x7f373c201760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f3740b79640 1 -- 172.21.15.55:0/2959561176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373c206520 con 0x7f373c073a20 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f374137a640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f373c141930 0x7f373c15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f3740b79640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 0x7f373c205fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3730009930 tx=0x7f37300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc15fd50 con 0x7f46bc15f8c0 2024-05-10T03:53:50.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.516+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc15fed0 con 0x7f46bc148b00 2024-05-10T03:53:50.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730041070 con 0x7f373c073a20 2024-05-10T03:53:50.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f3742ddd640 1 -- 172.21.15.55:0/2959561176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373c15ae20 con 0x7f373c073a20 2024-05-10T03:53:50.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f3742ddd640 1 -- 172.21.15.55:0/2959561176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373c15b3e0 con 0x7f373c073a20 2024-05-10T03:53:50.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373003c870 con 0x7f373c073a20 2024-05-10T03:53:50.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730037040 con 0x7f373c073a20 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f46bad9d640 1 -- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46bc148b00 msgr2=0x7f46bc1403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f46bad9d640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46bc148b00 0x7f46bc1403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f46bad9d640 1 -- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc06f6a0 msgr2=0x7f46bc15e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f46bad9d640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc06f6a0 0x7f46bc15e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f46bad9d640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc13f390 con 0x7f46bc15f8c0 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.517+0000 7f46bad9d640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46bc15f8c0 0x7f46bc1408e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46b400be20 tx=0x7f46b400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.518+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4019070 con 0x7f46bc15f8c0 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.518+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46bc13f670 con 0x7f46bc15f8c0 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.518+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46bc140ef0 con 0x7f46bc15f8c0 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.518+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b4014440 con 0x7f46bc15f8c0 2024-05-10T03:53:50.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.519+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4014830 con 0x7f46bc15f8c0 2024-05-10T03:53:50.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.521+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46b401c070 con 0x7f46bc15f8c0 2024-05-10T03:53:50.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.521+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3730044070 con 0x7f373c073a20 2024-05-10T03:53:50.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.522+0000 7f46aaffd640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f469c0763a0 0x7f469c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.522+0000 7f46ba59c640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f469c0763a0 0x7f469c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.522+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f46b40974d0 con 0x7f46bc15f8c0 2024-05-10T03:53:50.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.522+0000 7f37397fa640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f37200763a0 0x7f3720078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.523+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f37300b8070 con 0x7f373c073a20 2024-05-10T03:53:50.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.523+0000 7f373bfff640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f37200763a0 0x7f3720078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.524+0000 7f373bfff640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f37200763a0 0x7f3720078860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f37280079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.524+0000 7f46ba59c640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f469c0763a0 0x7f469c078860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000c00 tx=0x7f46ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.524+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a0005290 con 0x7f46bc15f8c0 2024-05-10T03:53:50.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.524+0000 7f3742ddd640 1 -- 172.21.15.55:0/2959561176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c005290 con 0x7f373c073a20 2024-05-10T03:53:50.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.530+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f46b4060850 con 0x7f46bc15f8c0 2024-05-10T03:53:50.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.533+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f373c206520 con 0x7f373c073a20 2024-05-10T03:53:50.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.560+0000 7f8eb6ef6640 1 Processor -- start 2024-05-10T03:53:50.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.561+0000 7f8eb6ef6640 1 -- start start 2024-05-10T03:53:50.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f06b0247640 1 Processor -- start 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f8eb6ef6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8eb0072a40 0x7f8eb016bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f8eb6ef6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8eb0070090 0x7f8eb00b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f8eb6ef6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb0070cc0 con 0x7f8eb00d1b50 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f8eb6ef6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb00709e0 con 0x7f8eb0070090 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f8eb6ef6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb00b40d0 con 0x7f8eb0072a40 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.562+0000 7f8eb66f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8eb0070090 0x7f8eb00b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb66f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8eb0070090 0x7f8eb00b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56998/0 (socket says 172.21.15.55:56998) 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb56f3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8eb0072a40 0x7f8eb016bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb66f5640 1 -- 172.21.15.55:0/3058541188 learned_addr learned my addr 172.21.15.55:0/3058541188 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f06b0247640 1 -- start start 2024-05-10T03:53:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb66f5640 1 -- 172.21.15.55:0/3058541188 >> v2:172.21.15.64:3300/0 conn(0x7f8eb0072a40 msgr2=0x7f8eb016bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb66f5640 1 --2- 172.21.15.55:0/3058541188 >> v2:172.21.15.64:3300/0 conn(0x7f8eb0072a40 0x7f8eb016bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb66f5640 1 -- 172.21.15.55:0/3058541188 >> v1:172.21.15.64:6789/0 conn(0x7f8eb00d1b50 legacy=0x7f8eb0072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.563+0000 7f8eb66f5640 1 -- 172.21.15.55:0/3058541188 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb00b43b0 con 0x7f8eb0070090 2024-05-10T03:53:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f974d65b640 1 Processor -- start 2024-05-10T03:53:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f974d65b640 1 -- start start 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06b0247640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f06a004f850 0x7f06a0007130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06b0247640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0007670 0x7f06a0053ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06b0247640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a00df5a0 con 0x7f06a0054530 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06b0247640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f06a0006090 con 0x7f06a004f850 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06b0247640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f06a0006370 con 0x7f06a0007670 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f9675a62640 1 Processor -- start 2024-05-10T03:53:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f9675a62640 1 -- start start 2024-05-10T03:53:50.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06ae7e4640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f06a0054530 0x7f06a004fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:39698/0 (socket says 172.21.15.55:39698) 2024-05-10T03:53:50.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f06ae7e4640 1 -- 172.21.15.55:0/3319608369 learned_addr learned my addr 172.21.15.55:0/3319608369 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:50.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.564+0000 7f8eb66f5640 1 --2- 172.21.15.55:0/3058541188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb00b4bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8eb008cca0 tx=0x7f8eac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa2ad24f1a15f43 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f8eb4ef2640 1 -- 172.21.15.55:0/3058541188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac037070 con 0x7f8eb0070090 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f8eb4ef2640 1 -- 172.21.15.55:0/3058541188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac032440 con 0x7f8eb0070090 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f8eb4ef2640 1 -- 172.21.15.55:0/3058541188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac032810 con 0x7f8eb0070090 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f06ad7e2640 1 --2- 172.21.15.55:0/3319608369 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0007670 0x7f06a0053ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f06adfe3640 1 --2- 172.21.15.55:0/3319608369 >> v2:172.21.15.64:3300/0 conn(0x7f06a004f850 0x7f06a0007130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f06ad7e2640 1 -- 172.21.15.55:0/3319608369 >> v2:172.21.15.64:3300/0 conn(0x7f06a004f850 msgr2=0x7f06a0007130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f06ad7e2640 1 --2- 172.21.15.55:0/3319608369 >> v2:172.21.15.64:3300/0 conn(0x7f06a004f850 0x7f06a0007130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f06ad7e2640 1 -- 172.21.15.55:0/3319608369 >> v1:172.21.15.64:6789/0 conn(0x7f06a0054530 legacy=0x7f06a004fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f06ad7e2640 1 -- 172.21.15.55:0/3319608369 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a0006650 con 0x7f06a0007670 2024-05-10T03:53:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f9675a62640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9668047c90 0x7f96680065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f9675a62640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9668052f70 0x7f96680533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f9675a62640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966804f450 con 0x7f96680e7550 2024-05-10T03:53:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f9675a62640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f966804f730 con 0x7f9668047c90 2024-05-10T03:53:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.565+0000 7f9675a62640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f966804fbb0 con 0x7f9668052f70 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974d65b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9740050dd0 0x7f9740038630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974d65b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f974003a5d0 0x7f9740005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f9747fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97400e1090 0x7f9740039ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39778/0 (socket says 172.21.15.55:39778) 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f97477fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9740050dd0 0x7f9740038630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974ce5a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f974003a5d0 0x7f9740005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974ce5a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f974003a5d0 0x7f9740005fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49842/0 (socket says 172.21.15.55:49842) 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f97477fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9740050dd0 0x7f9740038630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39648/0 (socket says 172.21.15.55:39648) 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f9747fff640 1 -- 172.21.15.55:0/2552838942 learned_addr learned my addr 172.21.15.55:0/2552838942 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974004f540 con 0x7f97400e1090 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9668047c90 0x7f96680065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f9675261640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9668052f70 0x7f96680533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9668047c90 0x7f96680065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39636/0 (socket says 172.21.15.55:39636) 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 -- 172.21.15.55:0/1914929693 learned_addr learned my addr 172.21.15.55:0/1914929693 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 -- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9668052f70 msgr2=0x7f96680533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 --2- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9668052f70 0x7f96680533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 -- 172.21.15.55:0/1914929693 >> v1:172.21.15.64:6789/0 conn(0x7f96680e7550 legacy=0x7f9668005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f966ffff640 1 -- 172.21.15.55:0/1914929693 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966804fe90 con 0x7f9668047c90 2024-05-10T03:53:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f974004f820 con 0x7f9740050dd0 2024-05-10T03:53:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f974004fb00 con 0x7f974003a5d0 2024-05-10T03:53:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/3058541188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 msgr2=0x7f8eb00b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/3058541188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb00b4bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8eb008cca0 tx=0x7f8eac02a270 comp rx=0 tx=0).stop 2024-05-10T03:53:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/3058541188 shutdown_connections 2024-05-10T03:53:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/3058541188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb00b4bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/3058541188 >> v2:172.21.15.64:3300/0 conn(0x7f8eb0072a40 0x7f8eb016bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.566+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/3058541188 >> 172.21.15.55:0/3058541188 conn(0x7f8eb00d0f10 msgr2=0x7f8eb00d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f06ad7e2640 1 --2- 172.21.15.55:0/3319608369 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0007670 0x7f06a0053ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f069800a8a0 tx=0x7f069800a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f13c0f7a774bf27e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7fca0b59e640 1 Processor -- start 2024-05-10T03:53:50.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/3058541188 shutdown_connections 2024-05-10T03:53:50.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7fca0b59e640 1 -- start start 2024-05-10T03:53:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f97477fe640 1 -- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f974003a5d0 msgr2=0x7f9740005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f97477fe640 1 --2- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f974003a5d0 0x7f9740005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f97477fe640 1 -- 172.21.15.55:0/2552838942 >> v1:172.21.15.55:6789/0 conn(0x7f97400e1090 legacy=0x7f9740039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f97477fe640 1 -- 172.21.15.55:0/2552838942 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974004fde0 con 0x7f9740050dd0 2024-05-10T03:53:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/3058541188 wait complete. 2024-05-10T03:53:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f9746ffd640 1 -- 172.21.15.55:0/2552838942 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1061449174 0 0) 0x7f974004f540 con 0x7f97400e1090 2024-05-10T03:53:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f06acfe1640 1 -- 172.21.15.55:0/3319608369 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698039070 con 0x7f06a0007670 2024-05-10T03:53:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.567+0000 7f06acfe1640 1 -- 172.21.15.55:0/3319608369 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698033960 con 0x7f06a0007670 2024-05-10T03:53:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f966ffff640 1 --2- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668047c90 0x7f96680065e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9670063f70 tx=0x7f96700a6530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ce4980353f1982 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7faa9c81c640 1 Processor -- start 2024-05-10T03:53:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7faa9c81c640 1 -- start start 2024-05-10T03:53:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f06acfe1640 1 -- 172.21.15.55:0/3319608369 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698033d30 con 0x7f06a0007670 2024-05-10T03:53:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f966f7fe640 1 -- 172.21.15.55:0/1914929693 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967006e610 con 0x7f9668047c90 2024-05-10T03:53:50.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f966f7fe640 1 -- 172.21.15.55:0/1914929693 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967006e7b0 con 0x7f9668047c90 2024-05-10T03:53:50.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f966f7fe640 1 -- 172.21.15.55:0/1914929693 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967006ec20 con 0x7f9668047c90 2024-05-10T03:53:50.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f06b0247640 1 -- 172.21.15.55:0/3319608369 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0007670 msgr2=0x7f06a0053ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.568+0000 7f06b0247640 1 --2- 172.21.15.55:0/3319608369 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0007670 0x7f06a0053ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f069800a8a0 tx=0x7f069800a1a0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f97477fe640 1 --2- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f9740038630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97340097a0 tx=0x7f973402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ec2dfe67cede2e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7fca0b59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fca040df210 0x7fca04038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7fca0b59e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca04053c60 0x7fca0404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f06b0247640 1 -- 172.21.15.55:0/3319608369 shutdown_connections 2024-05-10T03:53:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f06b0247640 1 --2- 172.21.15.55:0/3319608369 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0007670 0x7f06a0053ff0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f06b0247640 1 --2- 172.21.15.55:0/3319608369 >> v2:172.21.15.64:3300/0 conn(0x7f06a004f850 0x7f06a0007130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f06b0247640 1 -- 172.21.15.55:0/3319608369 >> 172.21.15.55:0/3319608369 conn(0x7f06a0009fe0 msgr2=0x7f06a000a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7fca0b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca040544b0 con 0x7fca04033ee0 2024-05-10T03:53:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f8eb6ef6640 1 Processor -- start 2024-05-10T03:53:50.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f8eb6ef6640 1 -- start start 2024-05-10T03:53:50.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7fca0a59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fca040df210 0x7fca04038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7fca0a59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fca040df210 0x7fca04038070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39662/0 (socket says 172.21.15.55:39662) 2024-05-10T03:53:50.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7fca0a59c640 1 -- 172.21.15.55:0/2436394155 learned_addr learned my addr 172.21.15.55:0/2436394155 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f9675a62640 1 -- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668047c90 msgr2=0x7f96680065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f9675a62640 1 --2- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668047c90 0x7f96680065e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9670063f70 tx=0x7f96700a6530 comp rx=0 tx=0).stop 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f06b0247640 1 -- 172.21.15.55:0/3319608369 shutdown_connections 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f9675a62640 1 -- 172.21.15.55:0/1914929693 shutdown_connections 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f9675a62640 1 --2- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9668052f70 0x7f96680533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f9675a62640 1 --2- 172.21.15.55:0/1914929693 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668047c90 0x7f96680065e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f9675a62640 1 -- 172.21.15.55:0/1914929693 >> 172.21.15.55:0/1914929693 conn(0x7f9668009fa0 msgr2=0x7f966800a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7faa9c81c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa9806caa0 0x7faa980cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7faa9c81c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa98144de0 con 0x7faa98142080 2024-05-10T03:53:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7faa9c81c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa981450c0 con 0x7faa98142460 2024-05-10T03:53:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7faa9c81c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7faa980cdc10 con 0x7faa9806caa0 2024-05-10T03:53:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7fca09d9b640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca04053c60 0x7fca0404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa9659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa98142080 0x7faa98074270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39796/0 (socket says 172.21.15.55:39796) 2024-05-10T03:53:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa9659c640 1 -- 172.21.15.55:0/2148477971 learned_addr learned my addr 172.21.15.55:0/2148477971 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7f9675a62640 1 -- 172.21.15.55:0/1914929693 shutdown_connections 2024-05-10T03:53:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7f9675a62640 1 -- 172.21.15.55:0/1914929693 wait complete. 2024-05-10T03:53:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fca040541d0 con 0x7fca040df210 2024-05-10T03:53:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa96d9d640 1 --2- 172.21.15.55:0/2148477971 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa9806caa0 0x7faa980cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fca04005f70 con 0x7fca04053c60 2024-05-10T03:53:50.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191928088 0 0) 0x7fca040544b0 con 0x7fca04033ee0 2024-05-10T03:53:50.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa9559a640 1 -- 172.21.15.55:0/2148477971 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4656240 0 0) 0x7faa98144de0 con 0x7faa98142080 2024-05-10T03:53:50.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa96d9d640 1 -- 172.21.15.55:0/2148477971 >> v1:172.21.15.64:6789/0 conn(0x7faa98142460 legacy=0x7faa9806c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa96d9d640 1 -- 172.21.15.55:0/2148477971 >> v1:172.21.15.55:6789/0 conn(0x7faa98142080 legacy=0x7faa98074270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f4003520 con 0x7fca04033ee0 2024-05-10T03:53:50.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7faa96d9d640 1 -- 172.21.15.55:0/2148477971 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa981453a0 con 0x7faa9806caa0 2024-05-10T03:53:50.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1931130037 0 0) 0x7fc9f4003520 con 0x7fca04033ee0 2024-05-10T03:53:50.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.570+0000 7f8eb6ef6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb01660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb5ef4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb01660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb5ef4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb01660c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57008/0 (socket says 172.21.15.55:57008) 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb5ef4640 1 -- 172.21.15.55:0/1108708109 learned_addr learned my addr 172.21.15.55:0/1108708109 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8eb0072a40 0x7f8eb0166600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb00d1b50 0x7f8eb015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0070660 con 0x7f8eb0070090 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca04053c60 msgr2=0x7fca0404fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca04053c60 0x7fca0404fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 >> v2:172.21.15.64:3300/0 conn(0x7fca040df210 msgr2=0x7fca04038070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 --2- 172.21.15.55:0/2436394155 >> v2:172.21.15.64:3300/0 conn(0x7fca040df210 0x7fca04038070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb00704e0 con 0x7f8eb00d1b50 2024-05-10T03:53:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca04006250 con 0x7fca04033ee0 2024-05-10T03:53:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb00b50f0 con 0x7f8eb0072a40 2024-05-10T03:53:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7fca0c050740 con 0x7fca04033ee0 2024-05-10T03:53:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb56f3640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8eb0072a40 0x7f8eb0166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 >> v1:172.21.15.55:6789/0 conn(0x7fca04033ee0 legacy=0x7fca04006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.569+0000 7f06b0247640 1 -- 172.21.15.55:0/3319608369 wait complete. 2024-05-10T03:53:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f06b0247640 1 Processor -- start 2024-05-10T03:53:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f4004800 0x7fc9f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7fca0959a640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9f40052e0 0x7fc9f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f8eb66f5640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb00d1b50 0x7f8eb015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fca040541d0 con 0x7fc9f40039b0 2024-05-10T03:53:50.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fca04005f70 con 0x7fc9f4004800 2024-05-10T03:53:50.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f400c1c0 con 0x7fc9f40052e0 2024-05-10T03:53:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f9675a62640 1 Processor -- start 2024-05-10T03:53:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f9675a62640 1 -- start start 2024-05-10T03:53:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0ad9d640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9f40052e0 0x7fc9f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7faa96d9d640 1 --2- 172.21.15.55:0/2148477971 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa9806caa0 0x7faa980cd6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faa90009dc0 tx=0x7faa9002a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58aaebea982292d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb5ef4640 1 -- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8eb0072a40 msgr2=0x7f8eb0166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb5ef4640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8eb0072a40 0x7f8eb0166600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb5ef4640 1 -- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb00d1b50 msgr2=0x7f8eb015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb5ef4640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb00d1b50 0x7f8eb015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb5ef4640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb016ce10 con 0x7f8eb0070090 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca09d9b640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca04053c60 0x7fca0404fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7faa9559a640 1 -- 172.21.15.55:0/2148477971 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90007740 con 0x7faa9806caa0 2024-05-10T03:53:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7faa9559a640 1 -- 172.21.15.55:0/2148477971 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa900078e0 con 0x7faa9806caa0 2024-05-10T03:53:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb5ef4640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb01660c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c3a0 tx=0x7f8ea000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0017070 con 0x7f8eb0070090 2024-05-10T03:53:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb016d0f0 con 0x7f8eb0070090 2024-05-10T03:53:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea00052d0 con 0x7f8eb0070090 2024-05-10T03:53:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb016d6b0 con 0x7f8eb0070090 2024-05-10T03:53:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0003830 con 0x7f8eb0070090 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.571+0000 7f06b0247640 1 -- start start 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06b0247640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06a0007670 0x7f06a00dc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06b0247640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 0x7f06a00d8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06b0247640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0054530 0x7f06a004a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06b0247640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f06a0050340 con 0x7f06a004f850 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06b0247640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f06a0053390 con 0x7f06a0007670 2024-05-10T03:53:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06b0247640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f06a000ab00 con 0x7f06a0054530 2024-05-10T03:53:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f9675a62640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9668047c90 0x7f96680e5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06ad7e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 0x7f06a00d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7faa9c81c640 1 -- 172.21.15.55:0/2148477971 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa9806caa0 msgr2=0x7faa980cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2148477971 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa9806caa0 0x7faa980cd6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faa90009dc0 tx=0x7faa9002a5b0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06ad7e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 0x7f06a00d8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57022/0 (socket says 172.21.15.55:57022) 2024-05-10T03:53:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06ad7e2640 1 -- 172.21.15.55:0/4193515421 learned_addr learned my addr 172.21.15.55:0/4193515421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f9746ffd640 1 -- 172.21.15.55:0/2552838942 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734037070 con 0x7f9740050dd0 2024-05-10T03:53:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f9746ffd640 1 -- 172.21.15.55:0/2552838942 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9734032440 con 0x7f9740050dd0 2024-05-10T03:53:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f9746ffd640 1 -- 172.21.15.55:0/2552838942 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734032810 con 0x7f9740050dd0 2024-05-10T03:53:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7faa9c81c640 1 -- 172.21.15.55:0/2148477971 shutdown_connections 2024-05-10T03:53:50.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2148477971 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa9806caa0 0x7faa980cd6d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7faa9c81c640 1 -- 172.21.15.55:0/2148477971 >> 172.21.15.55:0/2148477971 conn(0x7faa980d1f40 msgr2=0x7faa980d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca09d9b640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f4004800 0x7fc9f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0ad9d640 1 -- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f4004800 msgr2=0x7fc9f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0ad9d640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f4004800 0x7fc9f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0ad9d640 1 -- 172.21.15.55:0/2436394155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f40039b0 msgr2=0x7fc9f4003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0ad9d640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.572+0000 7fca0ad9d640 1 -- 172.21.15.55:0/2436394155 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f4003520 con 0x7fc9f40052e0 2024-05-10T03:53:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7fca0a59c640 1 --2- 172.21.15.55:0/2436394155 >> v2:172.21.15.64:3300/0 conn(0x7fca040df210 0x7fca04038070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06adfe3640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06a0007670 0x7f06a00dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f06ae7e4640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0054530 0x7f06a004a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.573+0000 7f9675a62640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 0x7f96680e8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f9675a62640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96680e7550 0x7f966804a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f9675a62640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f96680e7ab0 con 0x7f9668047c90 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f9675a62640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f96680e7930 con 0x7f9668052f70 2024-05-10T03:53:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f9675a62640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f966804f070 con 0x7f96680e7550 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f06ad7e2640 1 -- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0054530 msgr2=0x7f06a004a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f06ad7e2640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0054530 0x7f06a004a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f06ad7e2640 1 -- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06a0007670 msgr2=0x7f06a00dc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f06ad7e2640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06a0007670 0x7f06a00dc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f06ad7e2640 1 -- 172.21.15.55:0/4193515421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a002cbf0 con 0x7f06a004f850 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7fca0ad9d640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9f40052e0 0x7fc9f400b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca0c06b980 tx=0x7fc9f4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff510a97c5dcaff7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c06a7e0 con 0x7fc9f40052e0 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c071190 con 0x7fc9f40052e0 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7fca0959a640 1 -- 172.21.15.55:0/2436394155 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0a8980 con 0x7fc9f40052e0 2024-05-10T03:53:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f966ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 0x7f96680e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f966ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 0x7f96680e8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39700/0 (socket says 172.21.15.55:39700) 2024-05-10T03:53:50.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f966ffff640 1 -- 172.21.15.55:0/223441045 learned_addr learned my addr 172.21.15.55:0/223441045 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 msgr2=0x7f9740038630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f974d65b640 1 --2- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f9740038630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97340097a0 tx=0x7f973402a180 comp rx=0 tx=0).stop 2024-05-10T03:53:50.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7f9675261640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96680e7550 0x7f966804a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f9674a60640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9668047c90 0x7f96680e5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.574+0000 7faa9c81c640 1 -- 172.21.15.55:0/2148477971 shutdown_connections 2024-05-10T03:53:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7faa9c81c640 1 -- 172.21.15.55:0/2148477971 wait complete. 2024-05-10T03:53:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9f40052e0 msgr2=0x7fc9f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7fca0b59e640 1 --2- 172.21.15.55:0/2436394155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9f40052e0 0x7fc9f400b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca0c06b980 tx=0x7fc9f4005830 comp rx=0 tx=0).stop 2024-05-10T03:53:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7fca0ad9d640 1 -- 172.21.15.55:0/2436394155 reap_dead start 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f06ad7e2640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 0x7f06a00d8250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f069800a9c0 tx=0x7f06980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966ffff640 1 -- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96680e7550 msgr2=0x7f966804a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966ffff640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96680e7550 0x7f966804a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966ffff640 1 -- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9668047c90 msgr2=0x7f96680e5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966ffff640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9668047c90 0x7f96680e5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966ffff640 1 -- 172.21.15.55:0/223441045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96680ea810 con 0x7f9668052f70 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f9675261640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96680e7550 0x7f966804a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966ffff640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 0x7f96680e8660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96700514f0 tx=0x7f967006c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 shutdown_connections 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f974d65b640 1 --2- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f9740038630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f974d65b640 1 --2- 172.21.15.55:0/2552838942 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f974003a5d0 0x7f9740005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 >> 172.21.15.55:0/2552838942 conn(0x7f9740009fb0 msgr2=0x7f974000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 shutdown_connections 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700ba070 con 0x7f9668052f70 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96680e4540 con 0x7f9668052f70 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.575+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96680e4b00 con 0x7f9668052f70 2024-05-10T03:53:50.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96700b6610 con 0x7f9668052f70 2024-05-10T03:53:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96700b69c0 con 0x7f9668052f70 2024-05-10T03:53:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 shutdown_connections 2024-05-10T03:53:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 >> 172.21.15.55:0/2436394155 conn(0x7fca04009fa0 msgr2=0x7fca0400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069803da90 con 0x7f06a004f850 2024-05-10T03:53:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 shutdown_connections 2024-05-10T03:53:50.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7fca0b59e640 1 -- 172.21.15.55:0/2436394155 wait complete. 2024-05-10T03:53:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ea001a070 con 0x7f8eb0070090 2024-05-10T03:53:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7faa9c81c640 1 Processor -- start 2024-05-10T03:53:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e98005290 con 0x7f8eb0070090 2024-05-10T03:53:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7f8ea67fc640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8e940763d0 0x7f8e94078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ea0096780 con 0x7f8eb0070090 2024-05-10T03:53:50.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7f974d65b640 1 -- 172.21.15.55:0/2552838942 wait complete. 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7faa9c81c640 1 -- start start 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7faa9c81c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 0x7faa9815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7faa9c81c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa98142080 0x7faa981419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7faa9c81c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa98142460 0x7faa981fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7faa9c81c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7faa98145960 con 0x7faa98142460 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7faa9c81c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faa98144b90 con 0x7faa9806caa0 2024-05-10T03:53:50.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7faa9c81c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7faa98073bf0 con 0x7faa98142080 2024-05-10T03:53:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7fca0b59e640 1 Processor -- start 2024-05-10T03:53:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a002ced0 con 0x7f06a004f850 2024-05-10T03:53:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.576+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a00dc5c0 con 0x7f06a004f850 2024-05-10T03:53:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069803dc30 con 0x7f06a004f850 2024-05-10T03:53:50.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.578+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698046460 con 0x7f06a004f850 2024-05-10T03:53:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7f8eb56f3640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8e940763d0 0x7f8e94078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7f974d65b640 1 Processor -- start 2024-05-10T03:53:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7faa95d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa98142080 0x7faa981419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7f8eb56f3640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8e940763d0 0x7f8e94078890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8eb008c580 tx=0x7f8ea800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7faa9659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 0x7faa9815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7faa9659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 0x7faa9815f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39706/0 (socket says 172.21.15.55:39706) 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7faa9659c640 1 -- 172.21.15.55:0/2985287910 learned_addr learned my addr 172.21.15.55:0/2985287910 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.577+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9650005290 con 0x7f9668052f70 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f96700b5070 con 0x7f9668052f70 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7f966d7fa640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f96540763a0 0x7f9654078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9670133330 con 0x7f9668052f70 2024-05-10T03:53:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa96d9d640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa98142460 0x7faa981fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0690005290 con 0x7f06a004f850 2024-05-10T03:53:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa9659c640 1 -- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa98142080 msgr2=0x7faa981419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa9659c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa98142080 0x7faa981419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa9659c640 1 -- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa98142460 msgr2=0x7faa981fd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa9659c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa98142460 0x7faa981fd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa9659c640 1 -- 172.21.15.55:0/2985287910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa981fd640 con 0x7faa9806caa0 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.579+0000 7fca0b59e640 1 -- start start 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0b59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 0x7fca0402b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0b59e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca0402be70 0x7fca04174610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa95d9b640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa98142080 0x7faa981419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca04174b50 0x7fca04174fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fca04037a80 con 0x7fca04174b50 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0b59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fca04037900 con 0x7fc9f40052e0 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0b59e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fca040df5f0 con 0x7fca0402be70 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa96d9d640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa98142460 0x7faa981fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 0x7fca0402b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca09d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca0402be70 0x7fca04174610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 0x7fca0402b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39720/0 (socket says 172.21.15.55:39720) 2024-05-10T03:53:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7fca0a59c640 1 -- 172.21.15.55:0/4137809090 learned_addr learned my addr 172.21.15.55:0/4137809090 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7faa9659c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 0x7faa9815f090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c480 tx=0x7faa8c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7f974d65b640 1 -- start start 2024-05-10T03:53:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0ad9d640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca04174b50 0x7fca04174fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.580+0000 7f9674a60640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f96540763a0 0x7f9654078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f9674a60640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f96540763a0 0x7f9654078860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f965c000f60 tx=0x7f965c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0a59c640 1 -- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca0402be70 msgr2=0x7fca04174610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0a59c640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca0402be70 0x7fca04174610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0a59c640 1 -- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca04174b50 msgr2=0x7fca04174fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0a59c640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca04174b50 0x7fca04174fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0a59c640 1 -- 172.21.15.55:0/4137809090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0402c380 con 0x7fc9f40052e0 2024-05-10T03:53:50.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7fca0a59c640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 0x7fca0402b930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c7f0 tx=0x7fc9fc00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f974d65b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f974003a5d0 0x7f97400cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f974d65b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f974016a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f974d65b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97400e1090 0x7f97400e2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f974d65b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9740006520 con 0x7f974003a5d0 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f974d65b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f97400503a0 con 0x7f9740050dd0 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.581+0000 7f974d65b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f97400066a0 con 0x7f97400e1090 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f97477fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f974016a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f97477fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f974016a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39732/0 (socket says 172.21.15.55:39732) 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f97477fe640 1 -- 172.21.15.55:0/2339131916 learned_addr learned my addr 172.21.15.55:0/2339131916 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97400e1090 0x7f97400e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f9747fff640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f974003a5d0 0x7f97400cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 -- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 msgr2=0x7f974016a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f974016a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 -- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f974003a5d0 msgr2=0x7f97400cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f974003a5d0 0x7f97400cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 -- 172.21.15.55:0/2339131916 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974004acc0 con 0x7f97400e1090 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f97477fe640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f974016a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974ce5a640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97400e1090 0x7f97400e2700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9748065ed0 tx=0x7f97480697c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748091070 con 0x7f97400e1090 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9748074650 con 0x7f97400e1090 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.582+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974004afa0 con 0x7f97400e1090 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.583+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748074a80 con 0x7f97400e1090 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.583+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f974016b0b0 con 0x7f97400e1090 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.583+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c018070 con 0x7faa9806caa0 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.583+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa98147a60 con 0x7faa9806caa0 2024-05-10T03:53:50.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.583+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa98148020 con 0x7faa9806caa0 2024-05-10T03:53:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.584+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f96700fc620 con 0x7f9668052f70 2024-05-10T03:53:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.584+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c0074e0 con 0x7faa9806caa0 2024-05-10T03:53:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.585+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c004a20 con 0x7faa9806caa0 2024-05-10T03:53:50.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.584+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974016ad70 con 0x7f97400e1090 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.584+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc015070 con 0x7fc9f40052e0 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.584+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0402c660 con 0x7fc9f40052e0 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.584+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0402cc20 con 0x7fc9f40052e0 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.585+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc007830 con 0x7fc9f40052e0 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.585+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9748096460 con 0x7f97400e1090 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.586+0000 7f9744ff9640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f972c0762d0 0x7f972c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.586+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9748113430 con 0x7f97400e1090 2024-05-10T03:53:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.586+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ea005fb00 con 0x7f8eb0070090 2024-05-10T03:53:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.586+0000 7f9747fff640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f972c0762d0 0x7f972c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.587+0000 7f9747fff640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f972c0762d0 0x7f972c078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f973c007fd0 tx=0x7f973c000f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.587+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc007c20 con 0x7fc9f40052e0 2024-05-10T03:53:50.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.588+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc9fc018070 con 0x7fc9f40052e0 2024-05-10T03:53:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.588+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0698044070 con 0x7f06a004f850 2024-05-10T03:53:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.588+0000 7fc9faffd640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc9ec0763a0 0x7fc9ec078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc9fc0974c0 con 0x7fc9f40052e0 2024-05-10T03:53:50.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa8c01b070 con 0x7faa9806caa0 2024-05-10T03:53:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7fca09d9b640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc9ec0763a0 0x7fc9ec078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7f069e7fc640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f068c0763a0 0x7f068c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f0005290 con 0x7fc9f40052e0 2024-05-10T03:53:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9806a7e0 con 0x7faa9806caa0 2024-05-10T03:53:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.589+0000 7fca09d9b640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc9ec0763a0 0x7fc9ec078860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca0404e820 tx=0x7fca00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.590+0000 7f06adfe3640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f068c0763a0 0x7f068c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.590+0000 7faa86ffd640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faa780762d0 0x7faa78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.590+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa8c096920 con 0x7faa9806caa0 2024-05-10T03:53:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.590+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06980b81a0 con 0x7f06a004f850 2024-05-10T03:53:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.591+0000 7faa95d9b640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faa780762d0 0x7faa78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.591+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f97480dc730 con 0x7f97400e1090 2024-05-10T03:53:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.591+0000 7f06adfe3640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f068c0763a0 0x7f068c078860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06a8000b60 tx=0x7f06a80680d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.594+0000 7faa95d9b640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faa780762d0 0x7faa78078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa981fc6a0 tx=0x7faa88007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.594+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc9fc0607f0 con 0x7fc9f40052e0 2024-05-10T03:53:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.595+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0698081490 con 0x7f06a004f850 2024-05-10T03:53:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.599+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa8c05fce0 con 0x7faa9806caa0 2024-05-10T03:53:50.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.970+0000 7f3742ddd640 1 -- 172.21.15.55:0/2959561176 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f371c005580 con 0x7f373c073a20 2024-05-10T03:53:50.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.971+0000 7f37397fa640 1 -- 172.21.15.55:0/2959561176 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37300819b0 con 0x7f373c073a20 2024-05-10T03:53:50.974 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2024-05-10T03:53:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.974+0000 7f3726ffd640 1 -- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f37200763a0 msgr2=0x7f3720078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.974+0000 7f3726ffd640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f37200763a0 0x7f3720078860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f37280079c0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.974+0000 7f3726ffd640 1 -- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 msgr2=0x7f373c205fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.974+0000 7f3726ffd640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 0x7f373c205fe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3730009930 tx=0x7f37300046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 -- 172.21.15.55:0/2959561176 shutdown_connections 2024-05-10T03:53:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f373c141930 0x7f373c15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f373c0ce090 0x7f373c201760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f37200763a0 0x7f3720078860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f46a0005580 con 0x7f46bc15f8c0 2024-05-10T03:53:50.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 --2- 172.21.15.55:0/2959561176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f373c073a20 0x7f373c205fe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 -- 172.21.15.55:0/2959561176 >> 172.21.15.55:0/2959561176 conn(0x7f373c0d1f40 msgr2=0x7f373c144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 -- 172.21.15.55:0/2959561176 shutdown_connections 2024-05-10T03:53:50.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.975+0000 7f3726ffd640 1 -- 172.21.15.55:0/2959561176 wait complete. 2024-05-10T03:53:50.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.976+0000 7f46aaffd640 1 -- 172.21.15.55:0/1560842603 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46b4064b50 con 0x7f46bc15f8c0 2024-05-10T03:53:50.980 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.979+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f469c0763a0 msgr2=0x7f469c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.979+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f469c0763a0 0x7f469c078860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000c00 tx=0x7f46ac02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46bc15f8c0 msgr2=0x7f46bc1408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46bc15f8c0 0x7f46bc1408e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f46b400be20 tx=0x7f46b400bf10 comp rx=0 tx=0).stop 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 shutdown_connections 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46bc15f8c0 0x7f46bc1408e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46bc148b00 0x7f46bc1403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f469c0763a0 0x7f469c078860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 --2- 172.21.15.55:0/1560842603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46bc06f6a0 0x7f46bc15e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.980+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 >> 172.21.15.55:0/1560842603 conn(0x7f46bc06e400 msgr2=0x7f46bc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.981+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 shutdown_connections 2024-05-10T03:53:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:50.981+0000 7f46c0d7f640 1 -- 172.21.15.55:0/1560842603 wait complete. 2024-05-10T03:53:50.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-05-10T03:53:50.996 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-10T03:53:51.001 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.009+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9650005580 con 0x7f9668052f70 2024-05-10T03:53:51.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.010+0000 7f966d7fa640 1 -- 172.21.15.55:0/223441045 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9670100920 con 0x7f9668052f70 2024-05-10T03:53:51.013 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:51.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f96540763a0 msgr2=0x7f9654078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f96540763a0 0x7f9654078860 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f965c000f60 tx=0x7f965c009040 comp rx=0 tx=0).stop 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 msgr2=0x7f96680e8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 0x7f96680e8660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96700514f0 tx=0x7f967006c2c0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 shutdown_connections 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96680e7550 0x7f966804a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9668052f70 0x7f96680e8660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.012+0000 7f9675a62640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f96540763a0 0x7f9654078860 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.013+0000 7f9675a62640 1 --2- 172.21.15.55:0/223441045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9668047c90 0x7f96680e5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.013+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 >> 172.21.15.55:0/223441045 conn(0x7f9668009fa0 msgr2=0x7f9668038da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.013+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 shutdown_connections 2024-05-10T03:53:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.013+0000 7f9675a62640 1 -- 172.21.15.55:0/223441045 wait complete. 2024-05-10T03:53:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.013+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc9f0005580 con 0x7fc9f40052e0 2024-05-10T03:53:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.014+0000 7fc9faffd640 1 -- 172.21.15.55:0/4137809090 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9fc064af0 con 0x7fc9f40052e0 2024-05-10T03:53:51.017 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-05-10T03:53:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc9ec0763a0 msgr2=0x7fc9ec078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc9ec0763a0 0x7fc9ec078860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca0404e820 tx=0x7fca00008040 comp rx=0 tx=0).stop 2024-05-10T03:53:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 msgr2=0x7fca0402b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 0x7fca0402b930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c7f0 tx=0x7fc9fc00cbf0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 shutdown_connections 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc9ec0763a0 0x7fc9ec078860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca04174b50 0x7fca04174fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca0402be70 0x7fca04174610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 --2- 172.21.15.55:0/4137809090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9f40052e0 0x7fca0402b930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 >> 172.21.15.55:0/4137809090 conn(0x7fca04009fa0 msgr2=0x7fca040dfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 shutdown_connections 2024-05-10T03:53:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.017+0000 7fca0b59e640 1 -- 172.21.15.55:0/4137809090 wait complete. 2024-05-10T03:53:51.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-05-10T03:53:51.029 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.028+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8e98005580 con 0x7f8eb0070090 2024-05-10T03:53:51.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.028+0000 7f8ea67fc640 1 -- 172.21.15.55:0/1108708109 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ea0068140 con 0x7f8eb0070090 2024-05-10T03:53:51.031 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:51.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-05-10T03:53:51.032 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8e940763d0 msgr2=0x7f8e94078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8e940763d0 0x7f8e94078890 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8eb008c580 tx=0x7f8ea800b040 comp rx=0 tx=0).stop 2024-05-10T03:53:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 msgr2=0x7f8eb01660c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb01660c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000c3a0 tx=0x7f8ea000c860 comp rx=0 tx=0).stop 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 shutdown_connections 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8eb00d1b50 0x7f8eb015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8eb0072a40 0x7f8eb0166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8e940763d0 0x7f8e94078890 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 --2- 172.21.15.55:0/1108708109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8eb0070090 0x7f8eb01660c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 >> 172.21.15.55:0/1108708109 conn(0x7f8eb00d0f10 msgr2=0x7f8eb016a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 shutdown_connections 2024-05-10T03:53:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.031+0000 7f8eb6ef6640 1 -- 172.21.15.55:0/1108708109 wait complete. 2024-05-10T03:53:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.039+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faa98073310 con 0x7faa9806caa0 2024-05-10T03:53:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.039+0000 7faa86ffd640 1 -- 172.21.15.55:0/2985287910 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa8c068320 con 0x7faa9806caa0 2024-05-10T03:53:51.042 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.040+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f97400052c0 con 0x7f97400e1090 2024-05-10T03:53:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.040+0000 7f9744ff9640 1 -- 172.21.15.55:0/2339131916 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97480e0a30 con 0x7f97400e1090 2024-05-10T03:53:51.043 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-05-10T03:53:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.041+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faa780762d0 msgr2=0x7faa78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.041+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faa780762d0 0x7faa78078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa981fc6a0 tx=0x7faa88007e30 comp rx=0 tx=0).stop 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 msgr2=0x7faa9815f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 0x7faa9815f090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c480 tx=0x7faa8c00c940 comp rx=0 tx=0).stop 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 shutdown_connections 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7faa780762d0 0x7faa78078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa98142460 0x7faa981fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa98142080 0x7faa981419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 --2- 172.21.15.55:0/2985287910 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa9806caa0 0x7faa9815f090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 >> 172.21.15.55:0/2985287910 conn(0x7faa980d1f40 msgr2=0x7faa980d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-10T03:53:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 shutdown_connections 2024-05-10T03:53:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.042+0000 7faa9c81c640 1 -- 172.21.15.55:0/2985287910 wait complete. 2024-05-10T03:53:51.046 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f972c0762d0 msgr2=0x7f972c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f972c0762d0 0x7f972c078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f973c007fd0 tx=0x7f973c000f10 comp rx=0 tx=0).stop 2024-05-10T03:53:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97400e1090 msgr2=0x7f97400e2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97400e1090 0x7f97400e2700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9748065ed0 tx=0x7f97480697c0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0690005850 con 0x7f06a004f850 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 shutdown_connections 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97400e1090 0x7f97400e2700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9740050dd0 0x7f974016a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f972c0762d0 0x7f972c078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 --2- 172.21.15.55:0/2339131916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f974003a5d0 0x7f97400cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 >> 172.21.15.55:0/2339131916 conn(0x7f9740009fb0 msgr2=0x7f97400e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 shutdown_connections 2024-05-10T03:53:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f974d65b640 1 -- 172.21.15.55:0/2339131916 wait complete. 2024-05-10T03:53:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.043+0000 7f069e7fc640 1 -- 172.21.15.55:0/4193515421 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0698085790 con 0x7f06a004f850 2024-05-10T03:53:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f068c0763a0 msgr2=0x7f068c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f068c0763a0 0x7f068c078860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f06a8000b60 tx=0x7f06a80680d0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 msgr2=0x7f06a00d8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 0x7f06a00d8250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f069800a9c0 tx=0x7f06980046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 shutdown_connections 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f06a0054530 0x7f06a004a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f068c0763a0 0x7f068c078860 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a004f850 0x7f06a00d8250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 --2- 172.21.15.55:0/4193515421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f06a0007670 0x7f06a00dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 >> 172.21.15.55:0/4193515421 conn(0x7f06a0009fe0 msgr2=0x7f06a00e1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 shutdown_connections 2024-05-10T03:53:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.046+0000 7f06b0247640 1 -- 172.21.15.55:0/4193515421 wait complete. 2024-05-10T03:53:51.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-05-10T03:53:51.057 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-05-10T03:53:51.063 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-05-10T03:53:51.064 DEBUG:teuthology.parallel:result is None 2024-05-10T03:53:51.064 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T03:53:51.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.205+0000 7f6ec1ac8640 1 Processor -- start 2024-05-10T03:53:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.205+0000 7f6ec1ac8640 1 -- start start 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ec1ac8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 0x7f6ebc0d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ec1ac8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6ebc0b4ed0 0x7f6ebc0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ec1ac8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc0b6250 con 0x7f6ebc15f5e0 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ec1ac8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc0d42b0 con 0x7f6ebc0b4ed0 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ec1ac8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b5640 con 0x7f6ebc0d5620 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ebb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6ebc15f5e0 0x7f6ebc0d4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39812/0 (socket says 172.21.15.55:39812) 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.206+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/346569310 learned_addr learned my addr 172.21.15.55:0/346569310 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebbfff640 1 --2- 172.21.15.55:0/346569310 >> v2:172.21.15.64:3300/0 conn(0x7f6ebc0b4ed0 0x7f6ebc0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051444990 0 0) 0x7f6ebc0b6250 con 0x7f6ebc15f5e0 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebaffd640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 0x7f6ebc0d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea4003520 con 0x7f6ebc15f5e0 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 937565252 0 0) 0x7f6ea4003520 con 0x7f6ebc15f5e0 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 msgr2=0x7f6ebc0d3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 0x7f6ebc0d3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 >> v2:172.21.15.64:3300/0 conn(0x7f6ebc0b4ed0 msgr2=0x7f6ebc0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 --2- 172.21.15.55:0/346569310 >> v2:172.21.15.64:3300/0 conn(0x7f6ebc0b4ed0 0x7f6ebc0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0b5920 con 0x7f6ebc15f5e0 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f6eac0016f0 con 0x7f6ebc15f5e0 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 >> v1:172.21.15.55:6789/0 conn(0x7f6ebc15f5e0 legacy=0x7f6ebc0d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ea4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 0x7f6ea4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4004d40 0x7f6ea40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0d42b0 con 0x7f6ea4003a00 2024-05-10T03:53:51.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b5640 con 0x7f6ea4004d40 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea400b9c0 con 0x7f6ebc0d5620 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ea4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebaffd640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 0x7f6ea4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebbfff640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4004d40 0x7f6ea40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 msgr2=0x7f6ea4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0d5620 0x7f6ea4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4004d40 msgr2=0x7f6ea40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4004d40 0x7f6ea40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/346569310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea4003520 con 0x7f6ea4003a00 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.207+0000 7f6ebbfff640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4004d40 0x7f6ea40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.208+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ea4003e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c210 tx=0x7f6ea4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01b73c4d44b67c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.208+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac007d50 con 0x7f6ea4003a00 2024-05-10T03:53:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.208+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac005ad0 con 0x7f6ea4003a00 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.208+0000 7f6eba7fc640 1 -- 172.21.15.55:0/346569310 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac007070 con 0x7f6ea4003a00 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/346569310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 msgr2=0x7f6ea4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/346569310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ea4003e20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c210 tx=0x7f6ea4005830 comp rx=0 tx=0).stop 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ebbfff640 1 -- 172.21.15.55:0/346569310 reap_dead start 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/346569310 shutdown_connections 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/346569310 >> 172.21.15.55:0/346569310 conn(0x7f6ebc08ec70 msgr2=0x7f6ebc09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/346569310 shutdown_connections 2024-05-10T03:53:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.209+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/346569310 wait complete. 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.210+0000 7f6ec1ac8640 1 Processor -- start 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.210+0000 7f6ec1ac8640 1 -- start start 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ec1ac8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ebc0baa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ec1ac8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ebc0c9540 0x7f6ebc0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ec1ac8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0b7e60 0x7f6ebc0b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ec1ac8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b5330 con 0x7f6ea4003a00 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ec1ac8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b5ee0 con 0x7f6ebc0c9540 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ec1ac8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc15f9c0 con 0x7f6ebc0b7e60 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ebc0baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ebc0baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57060/0 (socket says 172.21.15.55:57060) 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/1362040879 learned_addr learned my addr 172.21.15.55:0/1362040879 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebbfff640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0b7e60 0x7f6ebc0b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebaffd640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ebc0c9540 0x7f6ebc0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0b7e60 msgr2=0x7f6ebc0b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0b7e60 0x7f6ebc0b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ebc0c9540 msgr2=0x7f6ebc0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ebc0c9540 0x7f6ebc0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 -- 172.21.15.55:0/1362040879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc0c9d50 con 0x7f6ea4003a00 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebbfff640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0b7e60 0x7f6ebc0b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.211+0000 7f6ebb7fe640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ebc0baa60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02adb0 tx=0x7f6eac001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.212+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac041020 con 0x7f6ea4003a00 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.212+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac0014b0 con 0x7f6ea4003a00 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.212+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac007070 con 0x7f6ea4003a00 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.212+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc0ca030 con 0x7f6ea4003a00 2024-05-10T03:53:51.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.212+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc0ca5f0 con 0x7f6ea4003a00 2024-05-10T03:53:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.213+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc06e860 con 0x7f6ea4003a00 2024-05-10T03:53:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.213+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6eac044020 con 0x7f6ea4003a00 2024-05-10T03:53:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.214+0000 7f6ea3fff640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ea80762d0 0x7f6ea8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.214+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6eac0b7960 con 0x7f6ea4003a00 2024-05-10T03:53:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.214+0000 7f6ebaffd640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ea80762d0 0x7f6ea8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.214+0000 7f6ebaffd640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ea80762d0 0x7f6ea8078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0cb440 tx=0x7f6eb0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.218+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ebc06e860 con 0x7f6ea4003a00 2024-05-10T03:53:51.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.406+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ebc0a3270 con 0x7f6ea80762d0 2024-05-10T03:53:51.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.412+0000 7f6ea3fff640 1 -- 172.21.15.55:0/1362040879 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f6ebc0a3270 con 0x7f6ea80762d0 2024-05-10T03:53:51.418 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:51.420 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ea80762d0 msgr2=0x7f6ea8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ea80762d0 0x7f6ea8078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0cb440 tx=0x7f6eb0009190 comp rx=0 tx=0).stop 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 msgr2=0x7f6ebc0baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ebc0baa60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02adb0 tx=0x7f6eac001a30 comp rx=0 tx=0).stop 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 shutdown_connections 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ebc0b7e60 0x7f6ebc0b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ebc0c9540 0x7f6ebc0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ea80762d0 0x7f6ea8078790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.415+0000 7f6ec1ac8640 1 --2- 172.21.15.55:0/1362040879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea4003a00 0x7f6ebc0baa60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.416+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 >> 172.21.15.55:0/1362040879 conn(0x7f6ebc08ec70 msgr2=0x7f6ebc0d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.416+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 shutdown_connections 2024-05-10T03:53:51.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.416+0000 7f6ec1ac8640 1 -- 172.21.15.55:0/1362040879 wait complete. 2024-05-10T03:53:51.429 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-10T03:53:49.783918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236136,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738584,"statfs":{"total":773094113280,"available":772852310016,"internally_reserved":0,"allocated":2891776,"data_stored":1749940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.520134"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739883+0000","last_change":"2024-05-10T03:53:38.288661+0000","last_active":"2024-05-10T03:53:39.739883+0000","last_peered":"2024-05-10T03:53:39.739883+0000","last_clean":"2024-05-10T03:53:39.739883+0000","last_became_active":"2024-05-10T03:53:38.287374+0000","last_became_peered":"2024-05-10T03:53:38.287374+0000","last_unstale":"2024-05-10T03:53:39.739883+0000","last_undegraded":"2024-05-10T03:53:39.739883+0000","last_fullsized":"2024-05-10T03:53:39.739883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265472+0000","last_change":"2024-05-10T03:53:38.272836+0000","last_active":"2024-05-10T03:53:39.265472+0000","last_peered":"2024-05-10T03:53:39.265472+0000","last_clean":"2024-05-10T03:53:39.265472+0000","last_became_active":"2024-05-10T03:53:38.272458+0000","last_became_peered":"2024-05-10T03:53:38.272458+0000","last_unstale":"2024-05-10T03:53:39.265472+0000","last_undegraded":"2024-05-10T03:53:39.265472+0000","last_fullsized":"2024-05-10T03:53:39.265472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739779+0000","last_change":"2024-05-10T03:53:38.268359+0000","last_active":"2024-05-10T03:53:39.739779+0000","last_peered":"2024-05-10T03:53:39.739779+0000","last_clean":"2024-05-10T03:53:39.739779+0000","last_became_active":"2024-05-10T03:53:38.268051+0000","last_became_peered":"2024-05-10T03:53:38.268051+0000","last_unstale":"2024-05-10T03:53:39.739779+0000","last_undegraded":"2024-05-10T03:53:39.739779+0000","last_fullsized":"2024-05-10T03:53:39.739779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:48.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264426+0000","last_change":"2024-05-10T03:53:38.293481+0000","last_active":"2024-05-10T03:53:39.264426+0000","last_peered":"2024-05-10T03:53:39.264426+0000","last_clean":"2024-05-10T03:53:39.264426+0000","last_became_active":"2024-05-10T03:53:38.293159+0000","last_became_peered":"2024-05-10T03:53:38.293159+0000","last_unstale":"2024-05-10T03:53:39.264426+0000","last_undegraded":"2024-05-10T03:53:39.264426+0000","last_fullsized":"2024-05-10T03:53:39.264426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739524+0000","last_change":"2024-05-10T03:53:38.294420+0000","last_active":"2024-05-10T03:53:39.739524+0000","last_peered":"2024-05-10T03:53:39.739524+0000","last_clean":"2024-05-10T03:53:39.739524+0000","last_became_active":"2024-05-10T03:53:38.294120+0000","last_became_peered":"2024-05-10T03:53:38.294120+0000","last_unstale":"2024-05-10T03:53:39.739524+0000","last_undegraded":"2024-05-10T03:53:39.739524+0000","last_fullsized":"2024-05-10T03:53:39.739524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264398+0000","last_change":"2024-05-10T03:53:38.272472+0000","last_active":"2024-05-10T03:53:39.264398+0000","last_peered":"2024-05-10T03:53:39.264398+0000","last_clean":"2024-05-10T03:53:39.264398+0000","last_became_active":"2024-05-10T03:53:38.272160+0000","last_became_peered":"2024-05-10T03:53:38.272160+0000","last_unstale":"2024-05-10T03:53:39.264398+0000","last_undegraded":"2024-05-10T03:53:39.264398+0000","last_fullsized":"2024-05-10T03:53:39.264398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739331+0000","last_change":"2024-05-10T03:53:38.293020+0000","last_active":"2024-05-10T03:53:39.739331+0000","last_peered":"2024-05-10T03:53:39.739331+0000","last_clean":"2024-05-10T03:53:39.739331+0000","last_became_active":"2024-05-10T03:53:38.292705+0000","last_became_peered":"2024-05-10T03:53:38.292705+0000","last_unstale":"2024-05-10T03:53:39.739331+0000","last_undegraded":"2024-05-10T03:53:39.739331+0000","last_fullsized":"2024-05-10T03:53:39.739331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739887+0000","last_change":"2024-05-10T03:53:38.284864+0000","last_active":"2024-05-10T03:53:39.739887+0000","last_peered":"2024-05-10T03:53:39.739887+0000","last_clean":"2024-05-10T03:53:39.739887+0000","last_became_active":"2024-05-10T03:53:38.284218+0000","last_became_peered":"2024-05-10T03:53:38.284218+0000","last_unstale":"2024-05-10T03:53:39.739887+0000","last_undegraded":"2024-05-10T03:53:39.739887+0000","last_fullsized":"2024-05-10T03:53:39.739887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739948+0000","last_change":"2024-05-10T03:53:38.287775+0000","last_active":"2024-05-10T03:53:39.739948+0000","last_peered":"2024-05-10T03:53:39.739948+0000","last_clean":"2024-05-10T03:53:39.739948+0000","last_became_active":"2024-05-10T03:53:38.287415+0000","last_became_peered":"2024-05-10T03:53:38.287415+0000","last_unstale":"2024-05-10T03:53:39.739948+0000","last_undegraded":"2024-05-10T03:53:39.739948+0000","last_fullsized":"2024-05-10T03:53:39.739948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282193+0000","last_change":"2024-05-10T03:53:38.284657+0000","last_active":"2024-05-10T03:53:39.282193+0000","last_peered":"2024-05-10T03:53:39.282193+0000","last_clean":"2024-05-10T03:53:39.282193+0000","last_became_active":"2024-05-10T03:53:38.284355+0000","last_became_peered":"2024-05-10T03:53:38.284355+0000","last_unstale":"2024-05-10T03:53:39.282193+0000","last_undegraded":"2024-05-10T03:53:39.282193+0000","last_fullsized":"2024-05-10T03:53:39.282193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281859+0000","last_change":"2024-05-10T03:53:38.284078+0000","last_active":"2024-05-10T03:53:39.281859+0000","last_peered":"2024-05-10T03:53:39.281859+0000","last_clean":"2024-05-10T03:53:39.281859+0000","last_became_active":"2024-05-10T03:53:38.283536+0000","last_became_peered":"2024-05-10T03:53:38.283536+0000","last_unstale":"2024-05-10T03:53:39.281859+0000","last_undegraded":"2024-05-10T03:53:39.281859+0000","last_fullsized":"2024-05-10T03:53:39.281859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265420+0000","last_change":"2024-05-10T03:53:38.283440+0000","last_active":"2024-05-10T03:53:39.265420+0000","last_peered":"2024-05-10T03:53:39.265420+0000","last_clean":"2024-05-10T03:53:39.265420+0000","last_became_active":"2024-05-10T03:53:38.283164+0000","last_became_peered":"2024-05-10T03:53:38.283164+0000","last_unstale":"2024-05-10T03:53:39.265420+0000","last_undegraded":"2024-05-10T03:53:39.265420+0000","last_fullsized":"2024-05-10T03:53:39.265420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:06.608444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740425+0000","last_change":"2024-05-10T03:53:38.285762+0000","last_active":"2024-05-10T03:53:39.740425+0000","last_peered":"2024-05-10T03:53:39.740425+0000","last_clean":"2024-05-10T03:53:39.740425+0000","last_became_active":"2024-05-10T03:53:38.285417+0000","last_became_peered":"2024-05-10T03:53:38.285417+0000","last_unstale":"2024-05-10T03:53:39.740425+0000","last_undegraded":"2024-05-10T03:53:39.740425+0000","last_fullsized":"2024-05-10T03:53:39.740425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739884+0000","last_change":"2024-05-10T03:53:38.272933+0000","last_active":"2024-05-10T03:53:39.739884+0000","last_peered":"2024-05-10T03:53:39.739884+0000","last_clean":"2024-05-10T03:53:39.739884+0000","last_became_active":"2024-05-10T03:53:38.272640+0000","last_became_peered":"2024-05-10T03:53:38.272640+0000","last_unstale":"2024-05-10T03:53:39.739884+0000","last_undegraded":"2024-05-10T03:53:39.739884+0000","last_fullsized":"2024-05-10T03:53:39.739884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265166+0000","last_change":"2024-05-10T03:53:38.282326+0000","last_active":"2024-05-10T03:53:39.265166+0000","last_peered":"2024-05-10T03:53:39.265166+0000","last_clean":"2024-05-10T03:53:39.265166+0000","last_became_active":"2024-05-10T03:53:38.281972+0000","last_became_peered":"2024-05-10T03:53:38.281972+0000","last_unstale":"2024-05-10T03:53:39.265166+0000","last_undegraded":"2024-05-10T03:53:39.265166+0000","last_fullsized":"2024-05-10T03:53:39.265166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263803+0000","last_change":"2024-05-10T03:53:38.273240+0000","last_active":"2024-05-10T03:53:39.263803+0000","last_peered":"2024-05-10T03:53:39.263803+0000","last_clean":"2024-05-10T03:53:39.263803+0000","last_became_active":"2024-05-10T03:53:38.272959+0000","last_became_peered":"2024-05-10T03:53:38.272959+0000","last_unstale":"2024-05-10T03:53:39.263803+0000","last_undegraded":"2024-05-10T03:53:39.263803+0000","last_fullsized":"2024-05-10T03:53:39.263803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264807+0000","last_change":"2024-05-10T03:53:38.279725+0000","last_active":"2024-05-10T03:53:39.264807+0000","last_peered":"2024-05-10T03:53:39.264807+0000","last_clean":"2024-05-10T03:53:39.264807+0000","last_became_active":"2024-05-10T03:53:38.279431+0000","last_became_peered":"2024-05-10T03:53:38.279431+0000","last_unstale":"2024-05-10T03:53:39.264807+0000","last_undegraded":"2024-05-10T03:53:39.264807+0000","last_fullsized":"2024-05-10T03:53:39.264807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739515+0000","last_change":"2024-05-10T03:53:38.285220+0000","last_active":"2024-05-10T03:53:39.739515+0000","last_peered":"2024-05-10T03:53:39.739515+0000","last_clean":"2024-05-10T03:53:39.739515+0000","last_became_active":"2024-05-10T03:53:38.284921+0000","last_became_peered":"2024-05-10T03:53:38.284921+0000","last_unstale":"2024-05-10T03:53:39.739515+0000","last_undegraded":"2024-05-10T03:53:39.739515+0000","last_fullsized":"2024-05-10T03:53:39.739515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739873+0000","last_change":"2024-05-10T03:53:38.294490+0000","last_active":"2024-05-10T03:53:39.739873+0000","last_peered":"2024-05-10T03:53:39.739873+0000","last_clean":"2024-05-10T03:53:39.739873+0000","last_became_active":"2024-05-10T03:53:38.294235+0000","last_became_peered":"2024-05-10T03:53:38.294235+0000","last_unstale":"2024-05-10T03:53:39.739873+0000","last_undegraded":"2024-05-10T03:53:39.739873+0000","last_fullsized":"2024-05-10T03:53:39.739873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282104+0000","last_change":"2024-05-10T03:53:38.283315+0000","last_active":"2024-05-10T03:53:39.282104+0000","last_peered":"2024-05-10T03:53:39.282104+0000","last_clean":"2024-05-10T03:53:39.282104+0000","last_became_active":"2024-05-10T03:53:38.283022+0000","last_became_peered":"2024-05-10T03:53:38.283022+0000","last_unstale":"2024-05-10T03:53:39.282104+0000","last_undegraded":"2024-05-10T03:53:39.282104+0000","last_fullsized":"2024-05-10T03:53:39.282104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740216+0000","last_change":"2024-05-10T03:53:38.272217+0000","last_active":"2024-05-10T03:53:39.740216+0000","last_peered":"2024-05-10T03:53:39.740216+0000","last_clean":"2024-05-10T03:53:39.740216+0000","last_became_active":"2024-05-10T03:53:38.271877+0000","last_became_peered":"2024-05-10T03:53:38.271877+0000","last_unstale":"2024-05-10T03:53:39.740216+0000","last_undegraded":"2024-05-10T03:53:39.740216+0000","last_fullsized":"2024-05-10T03:53:39.740216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263880+0000","last_change":"2024-05-10T03:53:38.277088+0000","last_active":"2024-05-10T03:53:39.263880+0000","last_peered":"2024-05-10T03:53:39.263880+0000","last_clean":"2024-05-10T03:53:39.263880+0000","last_became_active":"2024-05-10T03:53:38.276824+0000","last_became_peered":"2024-05-10T03:53:38.276824+0000","last_unstale":"2024-05-10T03:53:39.263880+0000","last_undegraded":"2024-05-10T03:53:39.263880+0000","last_fullsized":"2024-05-10T03:53:39.263880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739566+0000","last_change":"2024-05-10T03:53:38.288727+0000","last_active":"2024-05-10T03:53:39.739566+0000","last_peered":"2024-05-10T03:53:39.739566+0000","last_clean":"2024-05-10T03:53:39.739566+0000","last_became_active":"2024-05-10T03:53:38.288432+0000","last_became_peered":"2024-05-10T03:53:38.288432+0000","last_unstale":"2024-05-10T03:53:39.739566+0000","last_undegraded":"2024-05-10T03:53:39.739566+0000","last_fullsized":"2024-05-10T03:53:39.739566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263999+0000","last_change":"2024-05-10T03:53:38.280010+0000","last_active":"2024-05-10T03:53:39.263999+0000","last_peered":"2024-05-10T03:53:39.263999+0000","last_clean":"2024-05-10T03:53:39.263999+0000","last_became_active":"2024-05-10T03:53:38.279685+0000","last_became_peered":"2024-05-10T03:53:38.279685+0000","last_unstale":"2024-05-10T03:53:39.263999+0000","last_undegraded":"2024-05-10T03:53:39.263999+0000","last_fullsized":"2024-05-10T03:53:39.263999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740768+0000","last_change":"2024-05-10T03:53:38.289402+0000","last_active":"2024-05-10T03:53:39.740768+0000","last_peered":"2024-05-10T03:53:39.740768+0000","last_clean":"2024-05-10T03:53:39.740768+0000","last_became_active":"2024-05-10T03:53:38.289056+0000","last_became_peered":"2024-05-10T03:53:38.289056+0000","last_unstale":"2024-05-10T03:53:39.740768+0000","last_undegraded":"2024-05-10T03:53:39.740768+0000","last_fullsized":"2024-05-10T03:53:39.740768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282219+0000","last_change":"2024-05-10T03:53:38.285946+0000","last_active":"2024-05-10T03:53:39.282219+0000","last_peered":"2024-05-10T03:53:39.282219+0000","last_clean":"2024-05-10T03:53:39.282219+0000","last_became_active":"2024-05-10T03:53:38.285673+0000","last_became_peered":"2024-05-10T03:53:38.285673+0000","last_unstale":"2024-05-10T03:53:39.282219+0000","last_undegraded":"2024-05-10T03:53:39.282219+0000","last_fullsized":"2024-05-10T03:53:39.282219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265431+0000","last_change":"2024-05-10T03:53:38.284555+0000","last_active":"2024-05-10T03:53:39.265431+0000","last_peered":"2024-05-10T03:53:39.265431+0000","last_clean":"2024-05-10T03:53:39.265431+0000","last_became_active":"2024-05-10T03:53:38.284271+0000","last_became_peered":"2024-05-10T03:53:38.284271+0000","last_unstale":"2024-05-10T03:53:39.265431+0000","last_undegraded":"2024-05-10T03:53:39.265431+0000","last_fullsized":"2024-05-10T03:53:39.265431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740719+0000","last_change":"2024-05-10T03:53:38.287638+0000","last_active":"2024-05-10T03:53:39.740719+0000","last_peered":"2024-05-10T03:53:39.740719+0000","last_clean":"2024-05-10T03:53:39.740719+0000","last_became_active":"2024-05-10T03:53:38.287378+0000","last_became_peered":"2024-05-10T03:53:38.287378+0000","last_unstale":"2024-05-10T03:53:39.740719+0000","last_undegraded":"2024-05-10T03:53:39.740719+0000","last_fullsized":"2024-05-10T03:53:39.740719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740296+0000","last_change":"2024-05-10T03:53:38.285862+0000","last_active":"2024-05-10T03:53:39.740296+0000","last_peered":"2024-05-10T03:53:39.740296+0000","last_clean":"2024-05-10T03:53:39.740296+0000","last_became_active":"2024-05-10T03:53:38.285480+0000","last_became_peered":"2024-05-10T03:53:38.285480+0000","last_unstale":"2024-05-10T03:53:39.740296+0000","last_undegraded":"2024-05-10T03:53:39.740296+0000","last_fullsized":"2024-05-10T03:53:39.740296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264048+0000","last_change":"2024-05-10T03:53:38.288261+0000","last_active":"2024-05-10T03:53:39.264048+0000","last_peered":"2024-05-10T03:53:39.264048+0000","last_clean":"2024-05-10T03:53:39.264048+0000","last_became_active":"2024-05-10T03:53:38.287960+0000","last_became_peered":"2024-05-10T03:53:38.287960+0000","last_unstale":"2024-05-10T03:53:39.264048+0000","last_undegraded":"2024-05-10T03:53:39.264048+0000","last_fullsized":"2024-05-10T03:53:39.264048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739269+0000","last_change":"2024-05-10T03:53:38.281223+0000","last_active":"2024-05-10T03:53:39.739269+0000","last_peered":"2024-05-10T03:53:39.739269+0000","last_clean":"2024-05-10T03:53:39.739269+0000","last_became_active":"2024-05-10T03:53:38.280925+0000","last_became_peered":"2024-05-10T03:53:38.280925+0000","last_unstale":"2024-05-10T03:53:39.739269+0000","last_undegraded":"2024-05-10T03:53:39.739269+0000","last_fullsized":"2024-05-10T03:53:39.739269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281698+0000","last_change":"2024-05-10T03:53:38.281574+0000","last_active":"2024-05-10T03:53:39.281698+0000","last_peered":"2024-05-10T03:53:39.281698+0000","last_clean":"2024-05-10T03:53:39.281698+0000","last_became_active":"2024-05-10T03:53:38.281248+0000","last_became_peered":"2024-05-10T03:53:38.281248+0000","last_unstale":"2024-05-10T03:53:39.281698+0000","last_undegraded":"2024-05-10T03:53:39.281698+0000","last_fullsized":"2024-05-10T03:53:39.281698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265201+0000","last_change":"2024-05-10T03:53:38.286690+0000","last_active":"2024-05-10T03:53:39.265201+0000","last_peered":"2024-05-10T03:53:39.265201+0000","last_clean":"2024-05-10T03:53:39.265201+0000","last_became_active":"2024-05-10T03:53:38.286328+0000","last_became_peered":"2024-05-10T03:53:38.286328+0000","last_unstale":"2024-05-10T03:53:39.265201+0000","last_undegraded":"2024-05-10T03:53:39.265201+0000","last_fullsized":"2024-05-10T03:53:39.265201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:54.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740539+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:39.740539+0000","last_peered":"2024-05-10T03:53:39.740539+0000","last_clean":"2024-05-10T03:53:39.740539+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:39.740539+0000","last_undegraded":"2024-05-10T03:53:39.740539+0000","last_fullsized":"2024-05-10T03:53:39.740539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740368+0000","last_change":"2024-05-10T03:53:38.287761+0000","last_active":"2024-05-10T03:53:39.740368+0000","last_peered":"2024-05-10T03:53:39.740368+0000","last_clean":"2024-05-10T03:53:39.740368+0000","last_became_active":"2024-05-10T03:53:38.286885+0000","last_became_peered":"2024-05-10T03:53:38.286885+0000","last_unstale":"2024-05-10T03:53:39.740368+0000","last_undegraded":"2024-05-10T03:53:39.740368+0000","last_fullsized":"2024-05-10T03:53:39.740368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281751+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:39.281751+0000","last_peered":"2024-05-10T03:53:39.281751+0000","last_clean":"2024-05-10T03:53:39.281751+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:39.281751+0000","last_undegraded":"2024-05-10T03:53:39.281751+0000","last_fullsized":"2024-05-10T03:53:39.281751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739717+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:39.739717+0000","last_peered":"2024-05-10T03:53:39.739717+0000","last_clean":"2024-05-10T03:53:39.739717+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:39.739717+0000","last_undegraded":"2024-05-10T03:53:39.739717+0000","last_fullsized":"2024-05-10T03:53:39.739717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740040+0000","last_change":"2024-05-10T03:53:38.290104+0000","last_active":"2024-05-10T03:53:39.740040+0000","last_peered":"2024-05-10T03:53:39.740040+0000","last_clean":"2024-05-10T03:53:39.740040+0000","last_became_active":"2024-05-10T03:53:38.289798+0000","last_became_peered":"2024-05-10T03:53:38.289798+0000","last_unstale":"2024-05-10T03:53:39.740040+0000","last_undegraded":"2024-05-10T03:53:39.740040+0000","last_fullsized":"2024-05-10T03:53:39.740040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264116+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:39.264116+0000","last_peered":"2024-05-10T03:53:39.264116+0000","last_clean":"2024-05-10T03:53:39.264116+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:39.264116+0000","last_undegraded":"2024-05-10T03:53:39.264116+0000","last_fullsized":"2024-05-10T03:53:39.264116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265151+0000","last_change":"2024-05-10T03:53:38.286333+0000","last_active":"2024-05-10T03:53:39.265151+0000","last_peered":"2024-05-10T03:53:39.265151+0000","last_clean":"2024-05-10T03:53:39.265151+0000","last_became_active":"2024-05-10T03:53:38.284982+0000","last_became_peered":"2024-05-10T03:53:38.284982+0000","last_unstale":"2024-05-10T03:53:39.265151+0000","last_undegraded":"2024-05-10T03:53:39.265151+0000","last_fullsized":"2024-05-10T03:53:39.265151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282035+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:39.282035+0000","last_peered":"2024-05-10T03:53:39.282035+0000","last_clean":"2024-05-10T03:53:39.282035+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:39.282035+0000","last_undegraded":"2024-05-10T03:53:39.282035+0000","last_fullsized":"2024-05-10T03:53:39.282035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264506+0000","last_change":"2024-05-10T03:53:38.282479+0000","last_active":"2024-05-10T03:53:39.264506+0000","last_peered":"2024-05-10T03:53:39.264506+0000","last_clean":"2024-05-10T03:53:39.264506+0000","last_became_active":"2024-05-10T03:53:38.278644+0000","last_became_peered":"2024-05-10T03:53:38.278644+0000","last_unstale":"2024-05-10T03:53:39.264506+0000","last_undegraded":"2024-05-10T03:53:39.264506+0000","last_fullsized":"2024-05-10T03:53:39.264506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264533+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:39.264533+0000","last_peered":"2024-05-10T03:53:39.264533+0000","last_clean":"2024-05-10T03:53:39.264533+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:39.264533+0000","last_undegraded":"2024-05-10T03:53:39.264533+0000","last_fullsized":"2024-05-10T03:53:39.264533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740124+0000","last_change":"2024-05-10T03:53:38.280103+0000","last_active":"2024-05-10T03:53:39.740124+0000","last_peered":"2024-05-10T03:53:39.740124+0000","last_clean":"2024-05-10T03:53:39.740124+0000","last_became_active":"2024-05-10T03:53:38.279821+0000","last_became_peered":"2024-05-10T03:53:38.279821+0000","last_unstale":"2024-05-10T03:53:39.740124+0000","last_undegraded":"2024-05-10T03:53:39.740124+0000","last_fullsized":"2024-05-10T03:53:39.740124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265414+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:39.265414+0000","last_peered":"2024-05-10T03:53:39.265414+0000","last_clean":"2024-05-10T03:53:39.265414+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:39.265414+0000","last_undegraded":"2024-05-10T03:53:39.265414+0000","last_fullsized":"2024-05-10T03:53:39.265414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265514+0000","last_change":"2024-05-10T03:53:38.281500+0000","last_active":"2024-05-10T03:53:39.265514+0000","last_peered":"2024-05-10T03:53:39.265514+0000","last_clean":"2024-05-10T03:53:39.265514+0000","last_became_active":"2024-05-10T03:53:38.281173+0000","last_became_peered":"2024-05-10T03:53:38.281173+0000","last_unstale":"2024-05-10T03:53:39.265514+0000","last_undegraded":"2024-05-10T03:53:39.265514+0000","last_fullsized":"2024-05-10T03:53:39.265514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282038+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:39.282038+0000","last_peered":"2024-05-10T03:53:39.282038+0000","last_clean":"2024-05-10T03:53:39.282038+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:39.282038+0000","last_undegraded":"2024-05-10T03:53:39.282038+0000","last_fullsized":"2024-05-10T03:53:39.282038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739639+0000","last_change":"2024-05-10T03:53:38.290859+0000","last_active":"2024-05-10T03:53:39.739639+0000","last_peered":"2024-05-10T03:53:39.739639+0000","last_clean":"2024-05-10T03:53:39.739639+0000","last_became_active":"2024-05-10T03:53:38.290575+0000","last_became_peered":"2024-05-10T03:53:38.290575+0000","last_unstale":"2024-05-10T03:53:39.739639+0000","last_undegraded":"2024-05-10T03:53:39.739639+0000","last_fullsized":"2024-05-10T03:53:39.739639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740395+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:39.740395+0000","last_peered":"2024-05-10T03:53:39.740395+0000","last_clean":"2024-05-10T03:53:39.740395+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:39.740395+0000","last_undegraded":"2024-05-10T03:53:39.740395+0000","last_fullsized":"2024-05-10T03:53:39.740395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739992+0000","last_change":"2024-05-10T03:53:38.277962+0000","last_active":"2024-05-10T03:53:39.739992+0000","last_peered":"2024-05-10T03:53:39.739992+0000","last_clean":"2024-05-10T03:53:39.739992+0000","last_became_active":"2024-05-10T03:53:38.277601+0000","last_became_peered":"2024-05-10T03:53:38.277601+0000","last_unstale":"2024-05-10T03:53:39.739992+0000","last_undegraded":"2024-05-10T03:53:39.739992+0000","last_fullsized":"2024-05-10T03:53:39.739992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264170+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:39.264170+0000","last_peered":"2024-05-10T03:53:39.264170+0000","last_clean":"2024-05-10T03:53:39.264170+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:39.264170+0000","last_undegraded":"2024-05-10T03:53:39.264170+0000","last_fullsized":"2024-05-10T03:53:39.264170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739591+0000","last_change":"2024-05-10T03:53:38.289892+0000","last_active":"2024-05-10T03:53:39.739591+0000","last_peered":"2024-05-10T03:53:39.739591+0000","last_clean":"2024-05-10T03:53:39.739591+0000","last_became_active":"2024-05-10T03:53:38.289548+0000","last_became_peered":"2024-05-10T03:53:38.289548+0000","last_unstale":"2024-05-10T03:53:39.739591+0000","last_undegraded":"2024-05-10T03:53:39.739591+0000","last_fullsized":"2024-05-10T03:53:39.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281775+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:39.281775+0000","last_peered":"2024-05-10T03:53:39.281775+0000","last_clean":"2024-05-10T03:53:39.281775+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:39.281775+0000","last_undegraded":"2024-05-10T03:53:39.281775+0000","last_fullsized":"2024-05-10T03:53:39.281775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281702+0000","last_change":"2024-05-10T03:53:38.282182+0000","last_active":"2024-05-10T03:53:39.281702+0000","last_peered":"2024-05-10T03:53:39.281702+0000","last_clean":"2024-05-10T03:53:39.281702+0000","last_became_active":"2024-05-10T03:53:38.281876+0000","last_became_peered":"2024-05-10T03:53:38.281876+0000","last_unstale":"2024-05-10T03:53:39.281702+0000","last_undegraded":"2024-05-10T03:53:39.281702+0000","last_fullsized":"2024-05-10T03:53:39.281702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739297+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:39.739297+0000","last_peered":"2024-05-10T03:53:39.739297+0000","last_clean":"2024-05-10T03:53:39.739297+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:39.739297+0000","last_undegraded":"2024-05-10T03:53:39.739297+0000","last_fullsized":"2024-05-10T03:53:39.739297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739300+0000","last_change":"2024-05-10T03:53:38.286582+0000","last_active":"2024-05-10T03:53:39.739300+0000","last_peered":"2024-05-10T03:53:39.739300+0000","last_clean":"2024-05-10T03:53:39.739300+0000","last_became_active":"2024-05-10T03:53:38.286302+0000","last_became_peered":"2024-05-10T03:53:38.286302+0000","last_unstale":"2024-05-10T03:53:39.739300+0000","last_undegraded":"2024-05-10T03:53:39.739300+0000","last_fullsized":"2024-05-10T03:53:39.739300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265577+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:39.265577+0000","last_peered":"2024-05-10T03:53:39.265577+0000","last_clean":"2024-05-10T03:53:39.265577+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:39.265577+0000","last_undegraded":"2024-05-10T03:53:39.265577+0000","last_fullsized":"2024-05-10T03:53:39.265577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739847+0000","last_change":"2024-05-10T03:53:38.285319+0000","last_active":"2024-05-10T03:53:39.739847+0000","last_peered":"2024-05-10T03:53:39.739847+0000","last_clean":"2024-05-10T03:53:39.739847+0000","last_became_active":"2024-05-10T03:53:38.284885+0000","last_became_peered":"2024-05-10T03:53:38.284885+0000","last_unstale":"2024-05-10T03:53:39.739847+0000","last_undegraded":"2024-05-10T03:53:39.739847+0000","last_fullsized":"2024-05-10T03:53:39.739847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739629+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:39.739629+0000","last_peered":"2024-05-10T03:53:39.739629+0000","last_clean":"2024-05-10T03:53:39.739629+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:39.739629+0000","last_undegraded":"2024-05-10T03:53:39.739629+0000","last_fullsized":"2024-05-10T03:53:39.739629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740026+0000","last_change":"2024-05-10T03:53:38.289329+0000","last_active":"2024-05-10T03:53:39.740026+0000","last_peered":"2024-05-10T03:53:39.740026+0000","last_clean":"2024-05-10T03:53:39.740026+0000","last_became_active":"2024-05-10T03:53:38.288826+0000","last_became_peered":"2024-05-10T03:53:38.288826+0000","last_unstale":"2024-05-10T03:53:39.740026+0000","last_undegraded":"2024-05-10T03:53:39.740026+0000","last_fullsized":"2024-05-10T03:53:39.740026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:21.126895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265522+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:39.265522+0000","last_peered":"2024-05-10T03:53:39.265522+0000","last_clean":"2024-05-10T03:53:39.265522+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:39.265522+0000","last_undegraded":"2024-05-10T03:53:39.265522+0000","last_fullsized":"2024-05-10T03:53:39.265522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264802+0000","last_change":"2024-05-10T03:53:38.293738+0000","last_active":"2024-05-10T03:53:39.264802+0000","last_peered":"2024-05-10T03:53:39.264802+0000","last_clean":"2024-05-10T03:53:39.264802+0000","last_became_active":"2024-05-10T03:53:38.293306+0000","last_became_peered":"2024-05-10T03:53:38.293306+0000","last_unstale":"2024-05-10T03:53:39.264802+0000","last_undegraded":"2024-05-10T03:53:39.264802+0000","last_fullsized":"2024-05-10T03:53:39.264802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739497+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:39.739497+0000","last_peered":"2024-05-10T03:53:39.739497+0000","last_clean":"2024-05-10T03:53:39.739497+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:39.739497+0000","last_undegraded":"2024-05-10T03:53:39.739497+0000","last_fullsized":"2024-05-10T03:53:39.739497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739619+0000","last_change":"2024-05-10T03:53:38.285973+0000","last_active":"2024-05-10T03:53:39.739619+0000","last_peered":"2024-05-10T03:53:39.739619+0000","last_clean":"2024-05-10T03:53:39.739619+0000","last_became_active":"2024-05-10T03:53:38.285695+0000","last_became_peered":"2024-05-10T03:53:38.285695+0000","last_unstale":"2024-05-10T03:53:39.739619+0000","last_undegraded":"2024-05-10T03:53:39.739619+0000","last_fullsized":"2024-05-10T03:53:39.739619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739339+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:39.739339+0000","last_peered":"2024-05-10T03:53:39.739339+0000","last_clean":"2024-05-10T03:53:39.739339+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:39.739339+0000","last_undegraded":"2024-05-10T03:53:39.739339+0000","last_fullsized":"2024-05-10T03:53:39.739339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263868+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:39.263868+0000","last_peered":"2024-05-10T03:53:39.263868+0000","last_clean":"2024-05-10T03:53:39.263868+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:39.263868+0000","last_undegraded":"2024-05-10T03:53:39.263868+0000","last_fullsized":"2024-05-10T03:53:39.263868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739475+0000","last_change":"2024-05-10T03:53:38.289280+0000","last_active":"2024-05-10T03:53:39.739475+0000","last_peered":"2024-05-10T03:53:39.739475+0000","last_clean":"2024-05-10T03:53:39.739475+0000","last_became_active":"2024-05-10T03:53:38.288941+0000","last_became_peered":"2024-05-10T03:53:38.288941+0000","last_unstale":"2024-05-10T03:53:39.739475+0000","last_undegraded":"2024-05-10T03:53:39.739475+0000","last_fullsized":"2024-05-10T03:53:39.739475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739157+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:39.739157+0000","last_peered":"2024-05-10T03:53:39.739157+0000","last_clean":"2024-05-10T03:53:39.739157+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:39.739157+0000","last_undegraded":"2024-05-10T03:53:39.739157+0000","last_fullsized":"2024-05-10T03:53:39.739157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739532+0000","last_change":"2024-05-10T03:53:38.287044+0000","last_active":"2024-05-10T03:53:39.739532+0000","last_peered":"2024-05-10T03:53:39.739532+0000","last_clean":"2024-05-10T03:53:39.739532+0000","last_became_active":"2024-05-10T03:53:38.286731+0000","last_became_peered":"2024-05-10T03:53:38.286731+0000","last_unstale":"2024-05-10T03:53:39.739532+0000","last_undegraded":"2024-05-10T03:53:39.739532+0000","last_fullsized":"2024-05-10T03:53:39.739532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:05.026634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739381+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:39.739381+0000","last_peered":"2024-05-10T03:53:39.739381+0000","last_clean":"2024-05-10T03:53:39.739381+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:39.739381+0000","last_undegraded":"2024-05-10T03:53:39.739381+0000","last_fullsized":"2024-05-10T03:53:39.739381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265186+0000","last_change":"2024-05-10T03:53:38.273845+0000","last_active":"2024-05-10T03:53:39.265186+0000","last_peered":"2024-05-10T03:53:39.265186+0000","last_clean":"2024-05-10T03:53:39.265186+0000","last_became_active":"2024-05-10T03:53:38.273237+0000","last_became_peered":"2024-05-10T03:53:38.273237+0000","last_unstale":"2024-05-10T03:53:39.265186+0000","last_undegraded":"2024-05-10T03:53:39.265186+0000","last_fullsized":"2024-05-10T03:53:39.265186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264285+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:39.264285+0000","last_peered":"2024-05-10T03:53:39.264285+0000","last_clean":"2024-05-10T03:53:39.264285+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:39.264285+0000","last_undegraded":"2024-05-10T03:53:39.264285+0000","last_fullsized":"2024-05-10T03:53:39.264285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265435+0000","last_change":"2024-05-10T03:53:38.281466+0000","last_active":"2024-05-10T03:53:39.265435+0000","last_peered":"2024-05-10T03:53:39.265435+0000","last_clean":"2024-05-10T03:53:39.265435+0000","last_became_active":"2024-05-10T03:53:38.281104+0000","last_became_peered":"2024-05-10T03:53:38.281104+0000","last_unstale":"2024-05-10T03:53:39.265435+0000","last_undegraded":"2024-05-10T03:53:39.265435+0000","last_fullsized":"2024-05-10T03:53:39.265435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265302+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:39.265302+0000","last_peered":"2024-05-10T03:53:39.265302+0000","last_clean":"2024-05-10T03:53:39.265302+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:39.265302+0000","last_undegraded":"2024-05-10T03:53:39.265302+0000","last_fullsized":"2024-05-10T03:53:39.265302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264277+0000","last_change":"2024-05-10T03:53:38.287931+0000","last_active":"2024-05-10T03:53:39.264277+0000","last_peered":"2024-05-10T03:53:39.264277+0000","last_clean":"2024-05-10T03:53:39.264277+0000","last_became_active":"2024-05-10T03:53:38.287647+0000","last_became_peered":"2024-05-10T03:53:38.287647+0000","last_unstale":"2024-05-10T03:53:39.264277+0000","last_undegraded":"2024-05-10T03:53:39.264277+0000","last_fullsized":"2024-05-10T03:53:39.264277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739944+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:39.739944+0000","last_peered":"2024-05-10T03:53:39.739944+0000","last_clean":"2024-05-10T03:53:39.739944+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:39.739944+0000","last_undegraded":"2024-05-10T03:53:39.739944+0000","last_fullsized":"2024-05-10T03:53:39.739944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265284+0000","last_change":"2024-05-10T03:53:38.280342+0000","last_active":"2024-05-10T03:53:39.265284+0000","last_peered":"2024-05-10T03:53:39.265284+0000","last_clean":"2024-05-10T03:53:39.265284+0000","last_became_active":"2024-05-10T03:53:38.279318+0000","last_became_peered":"2024-05-10T03:53:38.279318+0000","last_unstale":"2024-05-10T03:53:39.265284+0000","last_undegraded":"2024-05-10T03:53:39.265284+0000","last_fullsized":"2024-05-10T03:53:39.265284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265488+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:39.265488+0000","last_peered":"2024-05-10T03:53:39.265488+0000","last_clean":"2024-05-10T03:53:39.265488+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:39.265488+0000","last_undegraded":"2024-05-10T03:53:39.265488+0000","last_fullsized":"2024-05-10T03:53:39.265488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740780+0000","last_change":"2024-05-10T03:53:38.290232+0000","last_active":"2024-05-10T03:53:39.740780+0000","last_peered":"2024-05-10T03:53:39.740780+0000","last_clean":"2024-05-10T03:53:39.740780+0000","last_became_active":"2024-05-10T03:53:38.289945+0000","last_became_peered":"2024-05-10T03:53:38.289945+0000","last_unstale":"2024-05-10T03:53:39.740780+0000","last_undegraded":"2024-05-10T03:53:39.740780+0000","last_fullsized":"2024-05-10T03:53:39.740780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282115+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:39.282115+0000","last_peered":"2024-05-10T03:53:39.282115+0000","last_clean":"2024-05-10T03:53:39.282115+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:39.282115+0000","last_undegraded":"2024-05-10T03:53:39.282115+0000","last_fullsized":"2024-05-10T03:53:39.282115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740024+0000","last_change":"2024-05-10T03:53:38.277345+0000","last_active":"2024-05-10T03:53:39.740024+0000","last_peered":"2024-05-10T03:53:39.740024+0000","last_clean":"2024-05-10T03:53:39.740024+0000","last_became_active":"2024-05-10T03:53:38.273372+0000","last_became_peered":"2024-05-10T03:53:38.273372+0000","last_unstale":"2024-05-10T03:53:39.740024+0000","last_undegraded":"2024-05-10T03:53:39.740024+0000","last_fullsized":"2024-05-10T03:53:39.740024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739148+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:39.739148+0000","last_peered":"2024-05-10T03:53:39.739148+0000","last_clean":"2024-05-10T03:53:39.739148+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:39.739148+0000","last_undegraded":"2024-05-10T03:53:39.739148+0000","last_fullsized":"2024-05-10T03:53:39.739148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265162+0000","last_change":"2024-05-10T03:53:38.271356+0000","last_active":"2024-05-10T03:53:39.265162+0000","last_peered":"2024-05-10T03:53:39.265162+0000","last_clean":"2024-05-10T03:53:39.265162+0000","last_became_active":"2024-05-10T03:53:38.271041+0000","last_became_peered":"2024-05-10T03:53:38.271041+0000","last_unstale":"2024-05-10T03:53:39.265162+0000","last_undegraded":"2024-05-10T03:53:39.265162+0000","last_fullsized":"2024-05-10T03:53:39.265162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:02.308236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265262+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:39.265262+0000","last_peered":"2024-05-10T03:53:39.265262+0000","last_clean":"2024-05-10T03:53:39.265262+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:39.265262+0000","last_undegraded":"2024-05-10T03:53:39.265262+0000","last_fullsized":"2024-05-10T03:53:39.265262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740183+0000","last_change":"2024-05-10T03:53:38.283634+0000","last_active":"2024-05-10T03:53:39.740183+0000","last_peered":"2024-05-10T03:53:39.740183+0000","last_clean":"2024-05-10T03:53:39.740183+0000","last_became_active":"2024-05-10T03:53:38.283346+0000","last_became_peered":"2024-05-10T03:53:38.283346+0000","last_unstale":"2024-05-10T03:53:39.740183+0000","last_undegraded":"2024-05-10T03:53:39.740183+0000","last_fullsized":"2024-05-10T03:53:39.740183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265349+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:39.265349+0000","last_peered":"2024-05-10T03:53:39.265349+0000","last_clean":"2024-05-10T03:53:39.265349+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:39.265349+0000","last_undegraded":"2024-05-10T03:53:39.265349+0000","last_fullsized":"2024-05-10T03:53:39.265349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740534+0000","last_change":"2024-05-10T03:53:38.283122+0000","last_active":"2024-05-10T03:53:39.740534+0000","last_peered":"2024-05-10T03:53:39.740534+0000","last_clean":"2024-05-10T03:53:39.740534+0000","last_became_active":"2024-05-10T03:53:38.282829+0000","last_became_peered":"2024-05-10T03:53:38.282829+0000","last_unstale":"2024-05-10T03:53:39.740534+0000","last_undegraded":"2024-05-10T03:53:39.740534+0000","last_fullsized":"2024-05-10T03:53:39.740534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739663+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:39.739663+0000","last_peered":"2024-05-10T03:53:39.739663+0000","last_clean":"2024-05-10T03:53:39.739663+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:39.739663+0000","last_undegraded":"2024-05-10T03:53:39.739663+0000","last_fullsized":"2024-05-10T03:53:39.739663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282013+0000","last_change":"2024-05-10T03:53:38.287504+0000","last_active":"2024-05-10T03:53:39.282013+0000","last_peered":"2024-05-10T03:53:39.282013+0000","last_clean":"2024-05-10T03:53:39.282013+0000","last_became_active":"2024-05-10T03:53:38.287245+0000","last_became_peered":"2024-05-10T03:53:38.287245+0000","last_unstale":"2024-05-10T03:53:39.282013+0000","last_undegraded":"2024-05-10T03:53:39.282013+0000","last_fullsized":"2024-05-10T03:53:39.282013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264216+0000","last_change":"2024-05-10T03:53:38.282467+0000","last_active":"2024-05-10T03:53:39.264216+0000","last_peered":"2024-05-10T03:53:39.264216+0000","last_clean":"2024-05-10T03:53:39.264216+0000","last_became_active":"2024-05-10T03:53:38.282177+0000","last_became_peered":"2024-05-10T03:53:38.282177+0000","last_unstale":"2024-05-10T03:53:39.264216+0000","last_undegraded":"2024-05-10T03:53:39.264216+0000","last_fullsized":"2024-05-10T03:53:39.264216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739507+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:39.739507+0000","last_peered":"2024-05-10T03:53:39.739507+0000","last_clean":"2024-05-10T03:53:39.739507+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:39.739507+0000","last_undegraded":"2024-05-10T03:53:39.739507+0000","last_fullsized":"2024-05-10T03:53:39.739507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264617+0000","last_change":"2024-05-10T03:53:38.287053+0000","last_active":"2024-05-10T03:53:39.264617+0000","last_peered":"2024-05-10T03:53:39.264617+0000","last_clean":"2024-05-10T03:53:39.264617+0000","last_became_active":"2024-05-10T03:53:38.286767+0000","last_became_peered":"2024-05-10T03:53:38.286767+0000","last_unstale":"2024-05-10T03:53:39.264617+0000","last_undegraded":"2024-05-10T03:53:39.264617+0000","last_fullsized":"2024-05-10T03:53:39.264617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739812+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:39.739812+0000","last_peered":"2024-05-10T03:53:39.739812+0000","last_clean":"2024-05-10T03:53:39.739812+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:39.739812+0000","last_undegraded":"2024-05-10T03:53:39.739812+0000","last_fullsized":"2024-05-10T03:53:39.739812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740006+0000","last_change":"2024-05-10T03:53:38.281054+0000","last_active":"2024-05-10T03:53:39.740006+0000","last_peered":"2024-05-10T03:53:39.740006+0000","last_clean":"2024-05-10T03:53:39.740006+0000","last_became_active":"2024-05-10T03:53:38.280762+0000","last_became_peered":"2024-05-10T03:53:38.280762+0000","last_unstale":"2024-05-10T03:53:39.740006+0000","last_undegraded":"2024-05-10T03:53:39.740006+0000","last_fullsized":"2024-05-10T03:53:39.740006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740638+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:39.740638+0000","last_peered":"2024-05-10T03:53:39.740638+0000","last_clean":"2024-05-10T03:53:39.740638+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:39.740638+0000","last_undegraded":"2024-05-10T03:53:39.740638+0000","last_fullsized":"2024-05-10T03:53:39.740638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740557+0000","last_change":"2024-05-10T03:53:38.285034+0000","last_active":"2024-05-10T03:53:39.740557+0000","last_peered":"2024-05-10T03:53:39.740557+0000","last_clean":"2024-05-10T03:53:39.740557+0000","last_became_active":"2024-05-10T03:53:38.284756+0000","last_became_peered":"2024-05-10T03:53:38.284756+0000","last_unstale":"2024-05-10T03:53:39.740557+0000","last_undegraded":"2024-05-10T03:53:39.740557+0000","last_fullsized":"2024-05-10T03:53:39.740557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740208+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:39.740208+0000","last_peered":"2024-05-10T03:53:39.740208+0000","last_clean":"2024-05-10T03:53:39.740208+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:39.740208+0000","last_undegraded":"2024-05-10T03:53:39.740208+0000","last_fullsized":"2024-05-10T03:53:39.740208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":802816,"data_stored":661498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":70708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":811008,"data_stored":661554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:51.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:53:51.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.570+0000 7f75c556a640 1 Processor -- start 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.570+0000 7f75c556a640 1 -- start start 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75c556a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00d5620 0x7f75c00d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75c556a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75c00b4ed0 0x7f75c00d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75c556a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c00b6250 con 0x7f75c015f5e0 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75c556a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f75c00d42b0 con 0x7f75c00b4ed0 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75c556a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00b5640 con 0x7f75c00d5620 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75c00b4ed0 0x7f75c00d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75c00b4ed0 0x7f75c00d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57072/0 (socket says 172.21.15.55:57072) 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 -- 172.21.15.55:0/2533161483 learned_addr learned my addr 172.21.15.55:0/2533161483 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:51.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75beffd640 1 --1- 172.21.15.55:0/2533161483 >> v1:172.21.15.55:6789/0 conn(0x7f75c015f5e0 0x7f75c00d4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39816/0 (socket says 172.21.15.55:39816) 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75be7fc640 1 --2- 172.21.15.55:0/2533161483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00d5620 0x7f75c00d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 -- 172.21.15.55:0/2533161483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00d5620 msgr2=0x7f75c00d3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 --2- 172.21.15.55:0/2533161483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00d5620 0x7f75c00d3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 -- 172.21.15.55:0/2533161483 >> v1:172.21.15.55:6789/0 conn(0x7f75c015f5e0 legacy=0x7f75c00d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.571+0000 7f75bf7fe640 1 -- 172.21.15.55:0/2533161483 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c00b5920 con 0x7f75c00b4ed0 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.572+0000 7f75bf7fe640 1 --2- 172.21.15.55:0/2533161483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00b4ed0 0x7f75c00d0150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009e50 tx=0x7f75b802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d819daa5b30330 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.572+0000 7f75bdffb640 1 -- 172.21.15.55:0/2533161483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8036070 con 0x7f75c00b4ed0 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.572+0000 7f75bdffb640 1 -- 172.21.15.55:0/2533161483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b8031600 con 0x7f75c00b4ed0 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.572+0000 7f75bdffb640 1 -- 172.21.15.55:0/2533161483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b80319d0 con 0x7f75c00b4ed0 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 -- 172.21.15.55:0/2533161483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00b4ed0 msgr2=0x7f75c00d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 --2- 172.21.15.55:0/2533161483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00b4ed0 0x7f75c00d0150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009e50 tx=0x7f75b802a710 comp rx=0 tx=0).stop 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 -- 172.21.15.55:0/2533161483 shutdown_connections 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 --2- 172.21.15.55:0/2533161483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00b4ed0 0x7f75c00d0150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 --2- 172.21.15.55:0/2533161483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00d5620 0x7f75c00d3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 -- 172.21.15.55:0/2533161483 >> 172.21.15.55:0/2533161483 conn(0x7f75c008ec70 msgr2=0x7f75c009e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 -- 172.21.15.55:0/2533161483 shutdown_connections 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.573+0000 7f75c556a640 1 -- 172.21.15.55:0/2533161483 wait complete. 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.574+0000 7f75c556a640 1 Processor -- start 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.574+0000 7f75c556a640 1 -- start start 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75c556a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00b4ed0 0x7f75c00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75c556a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 0x7f75c00b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75c556a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75c015f5e0 0x7f75c00b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75c556a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00b5330 con 0x7f75c00d5620 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75c556a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00b5ee0 con 0x7f75c015f5e0 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75c556a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f75c015f9c0 con 0x7f75c00b4ed0 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 0x7f75c00b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 0x7f75c00b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57088/0 (socket says 172.21.15.55:57088) 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 -- 172.21.15.55:0/574338541 learned_addr learned my addr 172.21.15.55:0/574338541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75beffd640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00b4ed0 0x7f75c00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75bf7fe640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75c015f5e0 0x7f75c00b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 -- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00b4ed0 msgr2=0x7f75c00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00b4ed0 0x7f75c00b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 -- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75c015f5e0 msgr2=0x7f75c00b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75c015f5e0 0x7f75c00b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.575+0000 7f75be7fc640 1 -- 172.21.15.55:0/574338541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c00b8ec0 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.576+0000 7f75be7fc640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 0x7f75c00b3a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75b400d620 tx=0x7f75b400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.576+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b400b620 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.576+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b4019070 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.576+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c00b91a0 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.576+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b400ba00 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.576+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c00b9760 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.577+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c00a3270 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.577+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75b400bba0 con 0x7f75c00d5620 2024-05-10T03:53:51.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.578+0000 7f75a77fe640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75ac0762d0 0x7f75ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.578+0000 7f75beffd640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75ac0762d0 0x7f75ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.578+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f75b40978b0 con 0x7f75c00d5620 2024-05-10T03:53:51.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.578+0000 7f75beffd640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75ac0762d0 0x7f75ac078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75b0000f60 tx=0x7f75b0000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.582+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75b4060bc0 con 0x7f75c00d5620 2024-05-10T03:53:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.772+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75c015e340 con 0x7f75ac0762d0 2024-05-10T03:53:51.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.778+0000 7f75a77fe640 1 -- 172.21.15.55:0/574338541 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f75c015e340 con 0x7f75ac0762d0 2024-05-10T03:53:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75ac0762d0 msgr2=0x7f75ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75ac0762d0 0x7f75ac078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75b0000f60 tx=0x7f75b0000bc0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 msgr2=0x7f75c00b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 0x7f75c00b3a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75b400d620 tx=0x7f75b400dae0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 shutdown_connections 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75c015f5e0 0x7f75c00b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75ac0762d0 0x7f75ac078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c00d5620 0x7f75c00b3a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 --2- 172.21.15.55:0/574338541 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75c00b4ed0 0x7f75c00b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 >> 172.21.15.55:0/574338541 conn(0x7f75c008ec70 msgr2=0x7f75c00d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 shutdown_connections 2024-05-10T03:53:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.781+0000 7f75c556a640 1 -- 172.21.15.55:0/574338541 wait complete. 2024-05-10T03:53:51.795 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-10T03:53:49.783918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236136,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738584,"statfs":{"total":773094113280,"available":772852310016,"internally_reserved":0,"allocated":2891776,"data_stored":1749940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.520134"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739883+0000","last_change":"2024-05-10T03:53:38.288661+0000","last_active":"2024-05-10T03:53:39.739883+0000","last_peered":"2024-05-10T03:53:39.739883+0000","last_clean":"2024-05-10T03:53:39.739883+0000","last_became_active":"2024-05-10T03:53:38.287374+0000","last_became_peered":"2024-05-10T03:53:38.287374+0000","last_unstale":"2024-05-10T03:53:39.739883+0000","last_undegraded":"2024-05-10T03:53:39.739883+0000","last_fullsized":"2024-05-10T03:53:39.739883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265472+0000","last_change":"2024-05-10T03:53:38.272836+0000","last_active":"2024-05-10T03:53:39.265472+0000","last_peered":"2024-05-10T03:53:39.265472+0000","last_clean":"2024-05-10T03:53:39.265472+0000","last_became_active":"2024-05-10T03:53:38.272458+0000","last_became_peered":"2024-05-10T03:53:38.272458+0000","last_unstale":"2024-05-10T03:53:39.265472+0000","last_undegraded":"2024-05-10T03:53:39.265472+0000","last_fullsized":"2024-05-10T03:53:39.265472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739779+0000","last_change":"2024-05-10T03:53:38.268359+0000","last_active":"2024-05-10T03:53:39.739779+0000","last_peered":"2024-05-10T03:53:39.739779+0000","last_clean":"2024-05-10T03:53:39.739779+0000","last_became_active":"2024-05-10T03:53:38.268051+0000","last_became_peered":"2024-05-10T03:53:38.268051+0000","last_unstale":"2024-05-10T03:53:39.739779+0000","last_undegraded":"2024-05-10T03:53:39.739779+0000","last_fullsized":"2024-05-10T03:53:39.739779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:48.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264426+0000","last_change":"2024-05-10T03:53:38.293481+0000","last_active":"2024-05-10T03:53:39.264426+0000","last_peered":"2024-05-10T03:53:39.264426+0000","last_clean":"2024-05-10T03:53:39.264426+0000","last_became_active":"2024-05-10T03:53:38.293159+0000","last_became_peered":"2024-05-10T03:53:38.293159+0000","last_unstale":"2024-05-10T03:53:39.264426+0000","last_undegraded":"2024-05-10T03:53:39.264426+0000","last_fullsized":"2024-05-10T03:53:39.264426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739524+0000","last_change":"2024-05-10T03:53:38.294420+0000","last_active":"2024-05-10T03:53:39.739524+0000","last_peered":"2024-05-10T03:53:39.739524+0000","last_clean":"2024-05-10T03:53:39.739524+0000","last_became_active":"2024-05-10T03:53:38.294120+0000","last_became_peered":"2024-05-10T03:53:38.294120+0000","last_unstale":"2024-05-10T03:53:39.739524+0000","last_undegraded":"2024-05-10T03:53:39.739524+0000","last_fullsized":"2024-05-10T03:53:39.739524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264398+0000","last_change":"2024-05-10T03:53:38.272472+0000","last_active":"2024-05-10T03:53:39.264398+0000","last_peered":"2024-05-10T03:53:39.264398+0000","last_clean":"2024-05-10T03:53:39.264398+0000","last_became_active":"2024-05-10T03:53:38.272160+0000","last_became_peered":"2024-05-10T03:53:38.272160+0000","last_unstale":"2024-05-10T03:53:39.264398+0000","last_undegraded":"2024-05-10T03:53:39.264398+0000","last_fullsized":"2024-05-10T03:53:39.264398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739331+0000","last_change":"2024-05-10T03:53:38.293020+0000","last_active":"2024-05-10T03:53:39.739331+0000","last_peered":"2024-05-10T03:53:39.739331+0000","last_clean":"2024-05-10T03:53:39.739331+0000","last_became_active":"2024-05-10T03:53:38.292705+0000","last_became_peered":"2024-05-10T03:53:38.292705+0000","last_unstale":"2024-05-10T03:53:39.739331+0000","last_undegraded":"2024-05-10T03:53:39.739331+0000","last_fullsized":"2024-05-10T03:53:39.739331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739887+0000","last_change":"2024-05-10T03:53:38.284864+0000","last_active":"2024-05-10T03:53:39.739887+0000","last_peered":"2024-05-10T03:53:39.739887+0000","last_clean":"2024-05-10T03:53:39.739887+0000","last_became_active":"2024-05-10T03:53:38.284218+0000","last_became_peered":"2024-05-10T03:53:38.284218+0000","last_unstale":"2024-05-10T03:53:39.739887+0000","last_undegraded":"2024-05-10T03:53:39.739887+0000","last_fullsized":"2024-05-10T03:53:39.739887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739948+0000","last_change":"2024-05-10T03:53:38.287775+0000","last_active":"2024-05-10T03:53:39.739948+0000","last_peered":"2024-05-10T03:53:39.739948+0000","last_clean":"2024-05-10T03:53:39.739948+0000","last_became_active":"2024-05-10T03:53:38.287415+0000","last_became_peered":"2024-05-10T03:53:38.287415+0000","last_unstale":"2024-05-10T03:53:39.739948+0000","last_undegraded":"2024-05-10T03:53:39.739948+0000","last_fullsized":"2024-05-10T03:53:39.739948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282193+0000","last_change":"2024-05-10T03:53:38.284657+0000","last_active":"2024-05-10T03:53:39.282193+0000","last_peered":"2024-05-10T03:53:39.282193+0000","last_clean":"2024-05-10T03:53:39.282193+0000","last_became_active":"2024-05-10T03:53:38.284355+0000","last_became_peered":"2024-05-10T03:53:38.284355+0000","last_unstale":"2024-05-10T03:53:39.282193+0000","last_undegraded":"2024-05-10T03:53:39.282193+0000","last_fullsized":"2024-05-10T03:53:39.282193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281859+0000","last_change":"2024-05-10T03:53:38.284078+0000","last_active":"2024-05-10T03:53:39.281859+0000","last_peered":"2024-05-10T03:53:39.281859+0000","last_clean":"2024-05-10T03:53:39.281859+0000","last_became_active":"2024-05-10T03:53:38.283536+0000","last_became_peered":"2024-05-10T03:53:38.283536+0000","last_unstale":"2024-05-10T03:53:39.281859+0000","last_undegraded":"2024-05-10T03:53:39.281859+0000","last_fullsized":"2024-05-10T03:53:39.281859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265420+0000","last_change":"2024-05-10T03:53:38.283440+0000","last_active":"2024-05-10T03:53:39.265420+0000","last_peered":"2024-05-10T03:53:39.265420+0000","last_clean":"2024-05-10T03:53:39.265420+0000","last_became_active":"2024-05-10T03:53:38.283164+0000","last_became_peered":"2024-05-10T03:53:38.283164+0000","last_unstale":"2024-05-10T03:53:39.265420+0000","last_undegraded":"2024-05-10T03:53:39.265420+0000","last_fullsized":"2024-05-10T03:53:39.265420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:06.608444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740425+0000","last_change":"2024-05-10T03:53:38.285762+0000","last_active":"2024-05-10T03:53:39.740425+0000","last_peered":"2024-05-10T03:53:39.740425+0000","last_clean":"2024-05-10T03:53:39.740425+0000","last_became_active":"2024-05-10T03:53:38.285417+0000","last_became_peered":"2024-05-10T03:53:38.285417+0000","last_unstale":"2024-05-10T03:53:39.740425+0000","last_undegraded":"2024-05-10T03:53:39.740425+0000","last_fullsized":"2024-05-10T03:53:39.740425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739884+0000","last_change":"2024-05-10T03:53:38.272933+0000","last_active":"2024-05-10T03:53:39.739884+0000","last_peered":"2024-05-10T03:53:39.739884+0000","last_clean":"2024-05-10T03:53:39.739884+0000","last_became_active":"2024-05-10T03:53:38.272640+0000","last_became_peered":"2024-05-10T03:53:38.272640+0000","last_unstale":"2024-05-10T03:53:39.739884+0000","last_undegraded":"2024-05-10T03:53:39.739884+0000","last_fullsized":"2024-05-10T03:53:39.739884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265166+0000","last_change":"2024-05-10T03:53:38.282326+0000","last_active":"2024-05-10T03:53:39.265166+0000","last_peered":"2024-05-10T03:53:39.265166+0000","last_clean":"2024-05-10T03:53:39.265166+0000","last_became_active":"2024-05-10T03:53:38.281972+0000","last_became_peered":"2024-05-10T03:53:38.281972+0000","last_unstale":"2024-05-10T03:53:39.265166+0000","last_undegraded":"2024-05-10T03:53:39.265166+0000","last_fullsized":"2024-05-10T03:53:39.265166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263803+0000","last_change":"2024-05-10T03:53:38.273240+0000","last_active":"2024-05-10T03:53:39.263803+0000","last_peered":"2024-05-10T03:53:39.263803+0000","last_clean":"2024-05-10T03:53:39.263803+0000","last_became_active":"2024-05-10T03:53:38.272959+0000","last_became_peered":"2024-05-10T03:53:38.272959+0000","last_unstale":"2024-05-10T03:53:39.263803+0000","last_undegraded":"2024-05-10T03:53:39.263803+0000","last_fullsized":"2024-05-10T03:53:39.263803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264807+0000","last_change":"2024-05-10T03:53:38.279725+0000","last_active":"2024-05-10T03:53:39.264807+0000","last_peered":"2024-05-10T03:53:39.264807+0000","last_clean":"2024-05-10T03:53:39.264807+0000","last_became_active":"2024-05-10T03:53:38.279431+0000","last_became_peered":"2024-05-10T03:53:38.279431+0000","last_unstale":"2024-05-10T03:53:39.264807+0000","last_undegraded":"2024-05-10T03:53:39.264807+0000","last_fullsized":"2024-05-10T03:53:39.264807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:10.219856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739515+0000","last_change":"2024-05-10T03:53:38.285220+0000","last_active":"2024-05-10T03:53:39.739515+0000","last_peered":"2024-05-10T03:53:39.739515+0000","last_clean":"2024-05-10T03:53:39.739515+0000","last_became_active":"2024-05-10T03:53:38.284921+0000","last_became_peered":"2024-05-10T03:53:38.284921+0000","last_unstale":"2024-05-10T03:53:39.739515+0000","last_undegraded":"2024-05-10T03:53:39.739515+0000","last_fullsized":"2024-05-10T03:53:39.739515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739873+0000","last_change":"2024-05-10T03:53:38.294490+0000","last_active":"2024-05-10T03:53:39.739873+0000","last_peered":"2024-05-10T03:53:39.739873+0000","last_clean":"2024-05-10T03:53:39.739873+0000","last_became_active":"2024-05-10T03:53:38.294235+0000","last_became_peered":"2024-05-10T03:53:38.294235+0000","last_unstale":"2024-05-10T03:53:39.739873+0000","last_undegraded":"2024-05-10T03:53:39.739873+0000","last_fullsized":"2024-05-10T03:53:39.739873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282104+0000","last_change":"2024-05-10T03:53:38.283315+0000","last_active":"2024-05-10T03:53:39.282104+0000","last_peered":"2024-05-10T03:53:39.282104+0000","last_clean":"2024-05-10T03:53:39.282104+0000","last_became_active":"2024-05-10T03:53:38.283022+0000","last_became_peered":"2024-05-10T03:53:38.283022+0000","last_unstale":"2024-05-10T03:53:39.282104+0000","last_undegraded":"2024-05-10T03:53:39.282104+0000","last_fullsized":"2024-05-10T03:53:39.282104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740216+0000","last_change":"2024-05-10T03:53:38.272217+0000","last_active":"2024-05-10T03:53:39.740216+0000","last_peered":"2024-05-10T03:53:39.740216+0000","last_clean":"2024-05-10T03:53:39.740216+0000","last_became_active":"2024-05-10T03:53:38.271877+0000","last_became_peered":"2024-05-10T03:53:38.271877+0000","last_unstale":"2024-05-10T03:53:39.740216+0000","last_undegraded":"2024-05-10T03:53:39.740216+0000","last_fullsized":"2024-05-10T03:53:39.740216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263880+0000","last_change":"2024-05-10T03:53:38.277088+0000","last_active":"2024-05-10T03:53:39.263880+0000","last_peered":"2024-05-10T03:53:39.263880+0000","last_clean":"2024-05-10T03:53:39.263880+0000","last_became_active":"2024-05-10T03:53:38.276824+0000","last_became_peered":"2024-05-10T03:53:38.276824+0000","last_unstale":"2024-05-10T03:53:39.263880+0000","last_undegraded":"2024-05-10T03:53:39.263880+0000","last_fullsized":"2024-05-10T03:53:39.263880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739566+0000","last_change":"2024-05-10T03:53:38.288727+0000","last_active":"2024-05-10T03:53:39.739566+0000","last_peered":"2024-05-10T03:53:39.739566+0000","last_clean":"2024-05-10T03:53:39.739566+0000","last_became_active":"2024-05-10T03:53:38.288432+0000","last_became_peered":"2024-05-10T03:53:38.288432+0000","last_unstale":"2024-05-10T03:53:39.739566+0000","last_undegraded":"2024-05-10T03:53:39.739566+0000","last_fullsized":"2024-05-10T03:53:39.739566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263999+0000","last_change":"2024-05-10T03:53:38.280010+0000","last_active":"2024-05-10T03:53:39.263999+0000","last_peered":"2024-05-10T03:53:39.263999+0000","last_clean":"2024-05-10T03:53:39.263999+0000","last_became_active":"2024-05-10T03:53:38.279685+0000","last_became_peered":"2024-05-10T03:53:38.279685+0000","last_unstale":"2024-05-10T03:53:39.263999+0000","last_undegraded":"2024-05-10T03:53:39.263999+0000","last_fullsized":"2024-05-10T03:53:39.263999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740768+0000","last_change":"2024-05-10T03:53:38.289402+0000","last_active":"2024-05-10T03:53:39.740768+0000","last_peered":"2024-05-10T03:53:39.740768+0000","last_clean":"2024-05-10T03:53:39.740768+0000","last_became_active":"2024-05-10T03:53:38.289056+0000","last_became_peered":"2024-05-10T03:53:38.289056+0000","last_unstale":"2024-05-10T03:53:39.740768+0000","last_undegraded":"2024-05-10T03:53:39.740768+0000","last_fullsized":"2024-05-10T03:53:39.740768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282219+0000","last_change":"2024-05-10T03:53:38.285946+0000","last_active":"2024-05-10T03:53:39.282219+0000","last_peered":"2024-05-10T03:53:39.282219+0000","last_clean":"2024-05-10T03:53:39.282219+0000","last_became_active":"2024-05-10T03:53:38.285673+0000","last_became_peered":"2024-05-10T03:53:38.285673+0000","last_unstale":"2024-05-10T03:53:39.282219+0000","last_undegraded":"2024-05-10T03:53:39.282219+0000","last_fullsized":"2024-05-10T03:53:39.282219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265431+0000","last_change":"2024-05-10T03:53:38.284555+0000","last_active":"2024-05-10T03:53:39.265431+0000","last_peered":"2024-05-10T03:53:39.265431+0000","last_clean":"2024-05-10T03:53:39.265431+0000","last_became_active":"2024-05-10T03:53:38.284271+0000","last_became_peered":"2024-05-10T03:53:38.284271+0000","last_unstale":"2024-05-10T03:53:39.265431+0000","last_undegraded":"2024-05-10T03:53:39.265431+0000","last_fullsized":"2024-05-10T03:53:39.265431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740719+0000","last_change":"2024-05-10T03:53:38.287638+0000","last_active":"2024-05-10T03:53:39.740719+0000","last_peered":"2024-05-10T03:53:39.740719+0000","last_clean":"2024-05-10T03:53:39.740719+0000","last_became_active":"2024-05-10T03:53:38.287378+0000","last_became_peered":"2024-05-10T03:53:38.287378+0000","last_unstale":"2024-05-10T03:53:39.740719+0000","last_undegraded":"2024-05-10T03:53:39.740719+0000","last_fullsized":"2024-05-10T03:53:39.740719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740296+0000","last_change":"2024-05-10T03:53:38.285862+0000","last_active":"2024-05-10T03:53:39.740296+0000","last_peered":"2024-05-10T03:53:39.740296+0000","last_clean":"2024-05-10T03:53:39.740296+0000","last_became_active":"2024-05-10T03:53:38.285480+0000","last_became_peered":"2024-05-10T03:53:38.285480+0000","last_unstale":"2024-05-10T03:53:39.740296+0000","last_undegraded":"2024-05-10T03:53:39.740296+0000","last_fullsized":"2024-05-10T03:53:39.740296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264048+0000","last_change":"2024-05-10T03:53:38.288261+0000","last_active":"2024-05-10T03:53:39.264048+0000","last_peered":"2024-05-10T03:53:39.264048+0000","last_clean":"2024-05-10T03:53:39.264048+0000","last_became_active":"2024-05-10T03:53:38.287960+0000","last_became_peered":"2024-05-10T03:53:38.287960+0000","last_unstale":"2024-05-10T03:53:39.264048+0000","last_undegraded":"2024-05-10T03:53:39.264048+0000","last_fullsized":"2024-05-10T03:53:39.264048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739269+0000","last_change":"2024-05-10T03:53:38.281223+0000","last_active":"2024-05-10T03:53:39.739269+0000","last_peered":"2024-05-10T03:53:39.739269+0000","last_clean":"2024-05-10T03:53:39.739269+0000","last_became_active":"2024-05-10T03:53:38.280925+0000","last_became_peered":"2024-05-10T03:53:38.280925+0000","last_unstale":"2024-05-10T03:53:39.739269+0000","last_undegraded":"2024-05-10T03:53:39.739269+0000","last_fullsized":"2024-05-10T03:53:39.739269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281698+0000","last_change":"2024-05-10T03:53:38.281574+0000","last_active":"2024-05-10T03:53:39.281698+0000","last_peered":"2024-05-10T03:53:39.281698+0000","last_clean":"2024-05-10T03:53:39.281698+0000","last_became_active":"2024-05-10T03:53:38.281248+0000","last_became_peered":"2024-05-10T03:53:38.281248+0000","last_unstale":"2024-05-10T03:53:39.281698+0000","last_undegraded":"2024-05-10T03:53:39.281698+0000","last_fullsized":"2024-05-10T03:53:39.281698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:08:00.049156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265201+0000","last_change":"2024-05-10T03:53:38.286690+0000","last_active":"2024-05-10T03:53:39.265201+0000","last_peered":"2024-05-10T03:53:39.265201+0000","last_clean":"2024-05-10T03:53:39.265201+0000","last_became_active":"2024-05-10T03:53:38.286328+0000","last_became_peered":"2024-05-10T03:53:38.286328+0000","last_unstale":"2024-05-10T03:53:39.265201+0000","last_undegraded":"2024-05-10T03:53:39.265201+0000","last_fullsized":"2024-05-10T03:53:39.265201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:54.584209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740539+0000","last_change":"2024-05-10T03:53:37.287304+0000","last_active":"2024-05-10T03:53:39.740539+0000","last_peered":"2024-05-10T03:53:39.740539+0000","last_clean":"2024-05-10T03:53:39.740539+0000","last_became_active":"2024-05-10T03:53:37.286968+0000","last_became_peered":"2024-05-10T03:53:37.286968+0000","last_unstale":"2024-05-10T03:53:39.740539+0000","last_undegraded":"2024-05-10T03:53:39.740539+0000","last_fullsized":"2024-05-10T03:53:39.740539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740368+0000","last_change":"2024-05-10T03:53:38.287761+0000","last_active":"2024-05-10T03:53:39.740368+0000","last_peered":"2024-05-10T03:53:39.740368+0000","last_clean":"2024-05-10T03:53:39.740368+0000","last_became_active":"2024-05-10T03:53:38.286885+0000","last_became_peered":"2024-05-10T03:53:38.286885+0000","last_unstale":"2024-05-10T03:53:39.740368+0000","last_undegraded":"2024-05-10T03:53:39.740368+0000","last_fullsized":"2024-05-10T03:53:39.740368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281751+0000","last_change":"2024-05-10T03:53:37.279674+0000","last_active":"2024-05-10T03:53:39.281751+0000","last_peered":"2024-05-10T03:53:39.281751+0000","last_clean":"2024-05-10T03:53:39.281751+0000","last_became_active":"2024-05-10T03:53:37.279350+0000","last_became_peered":"2024-05-10T03:53:37.279350+0000","last_unstale":"2024-05-10T03:53:39.281751+0000","last_undegraded":"2024-05-10T03:53:39.281751+0000","last_fullsized":"2024-05-10T03:53:39.281751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739717+0000","last_change":"2024-05-10T03:53:37.285366+0000","last_active":"2024-05-10T03:53:39.739717+0000","last_peered":"2024-05-10T03:53:39.739717+0000","last_clean":"2024-05-10T03:53:39.739717+0000","last_became_active":"2024-05-10T03:53:37.285007+0000","last_became_peered":"2024-05-10T03:53:37.285007+0000","last_unstale":"2024-05-10T03:53:39.739717+0000","last_undegraded":"2024-05-10T03:53:39.739717+0000","last_fullsized":"2024-05-10T03:53:39.739717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740040+0000","last_change":"2024-05-10T03:53:38.290104+0000","last_active":"2024-05-10T03:53:39.740040+0000","last_peered":"2024-05-10T03:53:39.740040+0000","last_clean":"2024-05-10T03:53:39.740040+0000","last_became_active":"2024-05-10T03:53:38.289798+0000","last_became_peered":"2024-05-10T03:53:38.289798+0000","last_unstale":"2024-05-10T03:53:39.740040+0000","last_undegraded":"2024-05-10T03:53:39.740040+0000","last_fullsized":"2024-05-10T03:53:39.740040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264116+0000","last_change":"2024-05-10T03:53:37.271455+0000","last_active":"2024-05-10T03:53:39.264116+0000","last_peered":"2024-05-10T03:53:39.264116+0000","last_clean":"2024-05-10T03:53:39.264116+0000","last_became_active":"2024-05-10T03:53:37.271154+0000","last_became_peered":"2024-05-10T03:53:37.271154+0000","last_unstale":"2024-05-10T03:53:39.264116+0000","last_undegraded":"2024-05-10T03:53:39.264116+0000","last_fullsized":"2024-05-10T03:53:39.264116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265151+0000","last_change":"2024-05-10T03:53:38.286333+0000","last_active":"2024-05-10T03:53:39.265151+0000","last_peered":"2024-05-10T03:53:39.265151+0000","last_clean":"2024-05-10T03:53:39.265151+0000","last_became_active":"2024-05-10T03:53:38.284982+0000","last_became_peered":"2024-05-10T03:53:38.284982+0000","last_unstale":"2024-05-10T03:53:39.265151+0000","last_undegraded":"2024-05-10T03:53:39.265151+0000","last_fullsized":"2024-05-10T03:53:39.265151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282035+0000","last_change":"2024-05-10T03:53:37.280278+0000","last_active":"2024-05-10T03:53:39.282035+0000","last_peered":"2024-05-10T03:53:39.282035+0000","last_clean":"2024-05-10T03:53:39.282035+0000","last_became_active":"2024-05-10T03:53:37.279969+0000","last_became_peered":"2024-05-10T03:53:37.279969+0000","last_unstale":"2024-05-10T03:53:39.282035+0000","last_undegraded":"2024-05-10T03:53:39.282035+0000","last_fullsized":"2024-05-10T03:53:39.282035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264506+0000","last_change":"2024-05-10T03:53:38.282479+0000","last_active":"2024-05-10T03:53:39.264506+0000","last_peered":"2024-05-10T03:53:39.264506+0000","last_clean":"2024-05-10T03:53:39.264506+0000","last_became_active":"2024-05-10T03:53:38.278644+0000","last_became_peered":"2024-05-10T03:53:38.278644+0000","last_unstale":"2024-05-10T03:53:39.264506+0000","last_undegraded":"2024-05-10T03:53:39.264506+0000","last_fullsized":"2024-05-10T03:53:39.264506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264533+0000","last_change":"2024-05-10T03:53:37.275541+0000","last_active":"2024-05-10T03:53:39.264533+0000","last_peered":"2024-05-10T03:53:39.264533+0000","last_clean":"2024-05-10T03:53:39.264533+0000","last_became_active":"2024-05-10T03:53:37.275237+0000","last_became_peered":"2024-05-10T03:53:37.275237+0000","last_unstale":"2024-05-10T03:53:39.264533+0000","last_undegraded":"2024-05-10T03:53:39.264533+0000","last_fullsized":"2024-05-10T03:53:39.264533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740124+0000","last_change":"2024-05-10T03:53:38.280103+0000","last_active":"2024-05-10T03:53:39.740124+0000","last_peered":"2024-05-10T03:53:39.740124+0000","last_clean":"2024-05-10T03:53:39.740124+0000","last_became_active":"2024-05-10T03:53:38.279821+0000","last_became_peered":"2024-05-10T03:53:38.279821+0000","last_unstale":"2024-05-10T03:53:39.740124+0000","last_undegraded":"2024-05-10T03:53:39.740124+0000","last_fullsized":"2024-05-10T03:53:39.740124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:42:33.014883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265414+0000","last_change":"2024-05-10T03:53:37.280273+0000","last_active":"2024-05-10T03:53:39.265414+0000","last_peered":"2024-05-10T03:53:39.265414+0000","last_clean":"2024-05-10T03:53:39.265414+0000","last_became_active":"2024-05-10T03:53:37.280008+0000","last_became_peered":"2024-05-10T03:53:37.280008+0000","last_unstale":"2024-05-10T03:53:39.265414+0000","last_undegraded":"2024-05-10T03:53:39.265414+0000","last_fullsized":"2024-05-10T03:53:39.265414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265514+0000","last_change":"2024-05-10T03:53:38.281500+0000","last_active":"2024-05-10T03:53:39.265514+0000","last_peered":"2024-05-10T03:53:39.265514+0000","last_clean":"2024-05-10T03:53:39.265514+0000","last_became_active":"2024-05-10T03:53:38.281173+0000","last_became_peered":"2024-05-10T03:53:38.281173+0000","last_unstale":"2024-05-10T03:53:39.265514+0000","last_undegraded":"2024-05-10T03:53:39.265514+0000","last_fullsized":"2024-05-10T03:53:39.265514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:05.515737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282038+0000","last_change":"2024-05-10T03:53:37.283184+0000","last_active":"2024-05-10T03:53:39.282038+0000","last_peered":"2024-05-10T03:53:39.282038+0000","last_clean":"2024-05-10T03:53:39.282038+0000","last_became_active":"2024-05-10T03:53:37.282905+0000","last_became_peered":"2024-05-10T03:53:37.282905+0000","last_unstale":"2024-05-10T03:53:39.282038+0000","last_undegraded":"2024-05-10T03:53:39.282038+0000","last_fullsized":"2024-05-10T03:53:39.282038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739639+0000","last_change":"2024-05-10T03:53:38.290859+0000","last_active":"2024-05-10T03:53:39.739639+0000","last_peered":"2024-05-10T03:53:39.739639+0000","last_clean":"2024-05-10T03:53:39.739639+0000","last_became_active":"2024-05-10T03:53:38.290575+0000","last_became_peered":"2024-05-10T03:53:38.290575+0000","last_unstale":"2024-05-10T03:53:39.739639+0000","last_undegraded":"2024-05-10T03:53:39.739639+0000","last_fullsized":"2024-05-10T03:53:39.739639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740395+0000","last_change":"2024-05-10T03:53:37.281691+0000","last_active":"2024-05-10T03:53:39.740395+0000","last_peered":"2024-05-10T03:53:39.740395+0000","last_clean":"2024-05-10T03:53:39.740395+0000","last_became_active":"2024-05-10T03:53:37.281413+0000","last_became_peered":"2024-05-10T03:53:37.281413+0000","last_unstale":"2024-05-10T03:53:39.740395+0000","last_undegraded":"2024-05-10T03:53:39.740395+0000","last_fullsized":"2024-05-10T03:53:39.740395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739992+0000","last_change":"2024-05-10T03:53:38.277962+0000","last_active":"2024-05-10T03:53:39.739992+0000","last_peered":"2024-05-10T03:53:39.739992+0000","last_clean":"2024-05-10T03:53:39.739992+0000","last_became_active":"2024-05-10T03:53:38.277601+0000","last_became_peered":"2024-05-10T03:53:38.277601+0000","last_unstale":"2024-05-10T03:53:39.739992+0000","last_undegraded":"2024-05-10T03:53:39.739992+0000","last_fullsized":"2024-05-10T03:53:39.739992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:04:37.926526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264170+0000","last_change":"2024-05-10T03:53:37.285228+0000","last_active":"2024-05-10T03:53:39.264170+0000","last_peered":"2024-05-10T03:53:39.264170+0000","last_clean":"2024-05-10T03:53:39.264170+0000","last_became_active":"2024-05-10T03:53:37.284780+0000","last_became_peered":"2024-05-10T03:53:37.284780+0000","last_unstale":"2024-05-10T03:53:39.264170+0000","last_undegraded":"2024-05-10T03:53:39.264170+0000","last_fullsized":"2024-05-10T03:53:39.264170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739591+0000","last_change":"2024-05-10T03:53:38.289892+0000","last_active":"2024-05-10T03:53:39.739591+0000","last_peered":"2024-05-10T03:53:39.739591+0000","last_clean":"2024-05-10T03:53:39.739591+0000","last_became_active":"2024-05-10T03:53:38.289548+0000","last_became_peered":"2024-05-10T03:53:38.289548+0000","last_unstale":"2024-05-10T03:53:39.739591+0000","last_undegraded":"2024-05-10T03:53:39.739591+0000","last_fullsized":"2024-05-10T03:53:39.739591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281775+0000","last_change":"2024-05-10T03:53:37.274418+0000","last_active":"2024-05-10T03:53:39.281775+0000","last_peered":"2024-05-10T03:53:39.281775+0000","last_clean":"2024-05-10T03:53:39.281775+0000","last_became_active":"2024-05-10T03:53:37.274055+0000","last_became_peered":"2024-05-10T03:53:37.274055+0000","last_unstale":"2024-05-10T03:53:39.281775+0000","last_undegraded":"2024-05-10T03:53:39.281775+0000","last_fullsized":"2024-05-10T03:53:39.281775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.281702+0000","last_change":"2024-05-10T03:53:38.282182+0000","last_active":"2024-05-10T03:53:39.281702+0000","last_peered":"2024-05-10T03:53:39.281702+0000","last_clean":"2024-05-10T03:53:39.281702+0000","last_became_active":"2024-05-10T03:53:38.281876+0000","last_became_peered":"2024-05-10T03:53:38.281876+0000","last_unstale":"2024-05-10T03:53:39.281702+0000","last_undegraded":"2024-05-10T03:53:39.281702+0000","last_fullsized":"2024-05-10T03:53:39.281702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739297+0000","last_change":"2024-05-10T03:53:37.275689+0000","last_active":"2024-05-10T03:53:39.739297+0000","last_peered":"2024-05-10T03:53:39.739297+0000","last_clean":"2024-05-10T03:53:39.739297+0000","last_became_active":"2024-05-10T03:53:37.275386+0000","last_became_peered":"2024-05-10T03:53:37.275386+0000","last_unstale":"2024-05-10T03:53:39.739297+0000","last_undegraded":"2024-05-10T03:53:39.739297+0000","last_fullsized":"2024-05-10T03:53:39.739297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739300+0000","last_change":"2024-05-10T03:53:38.286582+0000","last_active":"2024-05-10T03:53:39.739300+0000","last_peered":"2024-05-10T03:53:39.739300+0000","last_clean":"2024-05-10T03:53:39.739300+0000","last_became_active":"2024-05-10T03:53:38.286302+0000","last_became_peered":"2024-05-10T03:53:38.286302+0000","last_unstale":"2024-05-10T03:53:39.739300+0000","last_undegraded":"2024-05-10T03:53:39.739300+0000","last_fullsized":"2024-05-10T03:53:39.739300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:33:20.244541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265577+0000","last_change":"2024-05-10T03:53:37.274840+0000","last_active":"2024-05-10T03:53:39.265577+0000","last_peered":"2024-05-10T03:53:39.265577+0000","last_clean":"2024-05-10T03:53:39.265577+0000","last_became_active":"2024-05-10T03:53:37.274508+0000","last_became_peered":"2024-05-10T03:53:37.274508+0000","last_unstale":"2024-05-10T03:53:39.265577+0000","last_undegraded":"2024-05-10T03:53:39.265577+0000","last_fullsized":"2024-05-10T03:53:39.265577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:07:01.246105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739847+0000","last_change":"2024-05-10T03:53:38.285319+0000","last_active":"2024-05-10T03:53:39.739847+0000","last_peered":"2024-05-10T03:53:39.739847+0000","last_clean":"2024-05-10T03:53:39.739847+0000","last_became_active":"2024-05-10T03:53:38.284885+0000","last_became_peered":"2024-05-10T03:53:38.284885+0000","last_unstale":"2024-05-10T03:53:39.739847+0000","last_undegraded":"2024-05-10T03:53:39.739847+0000","last_fullsized":"2024-05-10T03:53:39.739847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:10.225834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739629+0000","last_change":"2024-05-10T03:53:37.283610+0000","last_active":"2024-05-10T03:53:39.739629+0000","last_peered":"2024-05-10T03:53:39.739629+0000","last_clean":"2024-05-10T03:53:39.739629+0000","last_became_active":"2024-05-10T03:53:37.282624+0000","last_became_peered":"2024-05-10T03:53:37.282624+0000","last_unstale":"2024-05-10T03:53:39.739629+0000","last_undegraded":"2024-05-10T03:53:39.739629+0000","last_fullsized":"2024-05-10T03:53:39.739629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740026+0000","last_change":"2024-05-10T03:53:38.289329+0000","last_active":"2024-05-10T03:53:39.740026+0000","last_peered":"2024-05-10T03:53:39.740026+0000","last_clean":"2024-05-10T03:53:39.740026+0000","last_became_active":"2024-05-10T03:53:38.288826+0000","last_became_peered":"2024-05-10T03:53:38.288826+0000","last_unstale":"2024-05-10T03:53:39.740026+0000","last_undegraded":"2024-05-10T03:53:39.740026+0000","last_fullsized":"2024-05-10T03:53:39.740026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:16:21.126895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265522+0000","last_change":"2024-05-10T03:53:37.276938+0000","last_active":"2024-05-10T03:53:39.265522+0000","last_peered":"2024-05-10T03:53:39.265522+0000","last_clean":"2024-05-10T03:53:39.265522+0000","last_became_active":"2024-05-10T03:53:37.276613+0000","last_became_peered":"2024-05-10T03:53:37.276613+0000","last_unstale":"2024-05-10T03:53:39.265522+0000","last_undegraded":"2024-05-10T03:53:39.265522+0000","last_fullsized":"2024-05-10T03:53:39.265522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264802+0000","last_change":"2024-05-10T03:53:38.293738+0000","last_active":"2024-05-10T03:53:39.264802+0000","last_peered":"2024-05-10T03:53:39.264802+0000","last_clean":"2024-05-10T03:53:39.264802+0000","last_became_active":"2024-05-10T03:53:38.293306+0000","last_became_peered":"2024-05-10T03:53:38.293306+0000","last_unstale":"2024-05-10T03:53:39.264802+0000","last_undegraded":"2024-05-10T03:53:39.264802+0000","last_fullsized":"2024-05-10T03:53:39.264802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:00.371085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739497+0000","last_change":"2024-05-10T03:53:37.275757+0000","last_active":"2024-05-10T03:53:39.739497+0000","last_peered":"2024-05-10T03:53:39.739497+0000","last_clean":"2024-05-10T03:53:39.739497+0000","last_became_active":"2024-05-10T03:53:37.275482+0000","last_became_peered":"2024-05-10T03:53:37.275482+0000","last_unstale":"2024-05-10T03:53:39.739497+0000","last_undegraded":"2024-05-10T03:53:39.739497+0000","last_fullsized":"2024-05-10T03:53:39.739497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:21:20.003947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739619+0000","last_change":"2024-05-10T03:53:38.285973+0000","last_active":"2024-05-10T03:53:39.739619+0000","last_peered":"2024-05-10T03:53:39.739619+0000","last_clean":"2024-05-10T03:53:39.739619+0000","last_became_active":"2024-05-10T03:53:38.285695+0000","last_became_peered":"2024-05-10T03:53:38.285695+0000","last_unstale":"2024-05-10T03:53:39.739619+0000","last_undegraded":"2024-05-10T03:53:39.739619+0000","last_fullsized":"2024-05-10T03:53:39.739619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:35:12.351376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739339+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:53:39.739339+0000","last_peered":"2024-05-10T03:53:39.739339+0000","last_clean":"2024-05-10T03:53:39.739339+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:53:39.739339+0000","last_undegraded":"2024-05-10T03:53:39.739339+0000","last_fullsized":"2024-05-10T03:53:39.739339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.263868+0000","last_change":"2024-05-10T03:53:37.275998+0000","last_active":"2024-05-10T03:53:39.263868+0000","last_peered":"2024-05-10T03:53:39.263868+0000","last_clean":"2024-05-10T03:53:39.263868+0000","last_became_active":"2024-05-10T03:53:37.275465+0000","last_became_peered":"2024-05-10T03:53:37.275465+0000","last_unstale":"2024-05-10T03:53:39.263868+0000","last_undegraded":"2024-05-10T03:53:39.263868+0000","last_fullsized":"2024-05-10T03:53:39.263868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739475+0000","last_change":"2024-05-10T03:53:38.289280+0000","last_active":"2024-05-10T03:53:39.739475+0000","last_peered":"2024-05-10T03:53:39.739475+0000","last_clean":"2024-05-10T03:53:39.739475+0000","last_became_active":"2024-05-10T03:53:38.288941+0000","last_became_peered":"2024-05-10T03:53:38.288941+0000","last_unstale":"2024-05-10T03:53:39.739475+0000","last_undegraded":"2024-05-10T03:53:39.739475+0000","last_fullsized":"2024-05-10T03:53:39.739475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739157+0000","last_change":"2024-05-10T03:53:37.285902+0000","last_active":"2024-05-10T03:53:39.739157+0000","last_peered":"2024-05-10T03:53:39.739157+0000","last_clean":"2024-05-10T03:53:39.739157+0000","last_became_active":"2024-05-10T03:53:37.285539+0000","last_became_peered":"2024-05-10T03:53:37.285539+0000","last_unstale":"2024-05-10T03:53:39.739157+0000","last_undegraded":"2024-05-10T03:53:39.739157+0000","last_fullsized":"2024-05-10T03:53:39.739157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739532+0000","last_change":"2024-05-10T03:53:38.287044+0000","last_active":"2024-05-10T03:53:39.739532+0000","last_peered":"2024-05-10T03:53:39.739532+0000","last_clean":"2024-05-10T03:53:39.739532+0000","last_became_active":"2024-05-10T03:53:38.286731+0000","last_became_peered":"2024-05-10T03:53:38.286731+0000","last_unstale":"2024-05-10T03:53:39.739532+0000","last_undegraded":"2024-05-10T03:53:39.739532+0000","last_fullsized":"2024-05-10T03:53:39.739532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:04:05.026634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739381+0000","last_change":"2024-05-10T03:53:37.278498+0000","last_active":"2024-05-10T03:53:39.739381+0000","last_peered":"2024-05-10T03:53:39.739381+0000","last_clean":"2024-05-10T03:53:39.739381+0000","last_became_active":"2024-05-10T03:53:37.278056+0000","last_became_peered":"2024-05-10T03:53:37.278056+0000","last_unstale":"2024-05-10T03:53:39.739381+0000","last_undegraded":"2024-05-10T03:53:39.739381+0000","last_fullsized":"2024-05-10T03:53:39.739381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:53.572927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265186+0000","last_change":"2024-05-10T03:53:38.273845+0000","last_active":"2024-05-10T03:53:39.265186+0000","last_peered":"2024-05-10T03:53:39.265186+0000","last_clean":"2024-05-10T03:53:39.265186+0000","last_became_active":"2024-05-10T03:53:38.273237+0000","last_became_peered":"2024-05-10T03:53:38.273237+0000","last_unstale":"2024-05-10T03:53:39.265186+0000","last_undegraded":"2024-05-10T03:53:39.265186+0000","last_fullsized":"2024-05-10T03:53:39.265186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.226998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264285+0000","last_change":"2024-05-10T03:53:37.272436+0000","last_active":"2024-05-10T03:53:39.264285+0000","last_peered":"2024-05-10T03:53:39.264285+0000","last_clean":"2024-05-10T03:53:39.264285+0000","last_became_active":"2024-05-10T03:53:37.271985+0000","last_became_peered":"2024-05-10T03:53:37.271985+0000","last_unstale":"2024-05-10T03:53:39.264285+0000","last_undegraded":"2024-05-10T03:53:39.264285+0000","last_fullsized":"2024-05-10T03:53:39.264285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265435+0000","last_change":"2024-05-10T03:53:38.281466+0000","last_active":"2024-05-10T03:53:39.265435+0000","last_peered":"2024-05-10T03:53:39.265435+0000","last_clean":"2024-05-10T03:53:39.265435+0000","last_became_active":"2024-05-10T03:53:38.281104+0000","last_became_peered":"2024-05-10T03:53:38.281104+0000","last_unstale":"2024-05-10T03:53:39.265435+0000","last_undegraded":"2024-05-10T03:53:39.265435+0000","last_fullsized":"2024-05-10T03:53:39.265435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:39.368574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265302+0000","last_change":"2024-05-10T03:53:37.281329+0000","last_active":"2024-05-10T03:53:39.265302+0000","last_peered":"2024-05-10T03:53:39.265302+0000","last_clean":"2024-05-10T03:53:39.265302+0000","last_became_active":"2024-05-10T03:53:37.280987+0000","last_became_peered":"2024-05-10T03:53:37.280987+0000","last_unstale":"2024-05-10T03:53:39.265302+0000","last_undegraded":"2024-05-10T03:53:39.265302+0000","last_fullsized":"2024-05-10T03:53:39.265302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:45.666275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264277+0000","last_change":"2024-05-10T03:53:38.287931+0000","last_active":"2024-05-10T03:53:39.264277+0000","last_peered":"2024-05-10T03:53:39.264277+0000","last_clean":"2024-05-10T03:53:39.264277+0000","last_became_active":"2024-05-10T03:53:38.287647+0000","last_became_peered":"2024-05-10T03:53:38.287647+0000","last_unstale":"2024-05-10T03:53:39.264277+0000","last_undegraded":"2024-05-10T03:53:39.264277+0000","last_fullsized":"2024-05-10T03:53:39.264277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:56.868191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739944+0000","last_change":"2024-05-10T03:53:37.286365+0000","last_active":"2024-05-10T03:53:39.739944+0000","last_peered":"2024-05-10T03:53:39.739944+0000","last_clean":"2024-05-10T03:53:39.739944+0000","last_became_active":"2024-05-10T03:53:37.286069+0000","last_became_peered":"2024-05-10T03:53:37.286069+0000","last_unstale":"2024-05-10T03:53:39.739944+0000","last_undegraded":"2024-05-10T03:53:39.739944+0000","last_fullsized":"2024-05-10T03:53:39.739944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:04.504455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265284+0000","last_change":"2024-05-10T03:53:38.280342+0000","last_active":"2024-05-10T03:53:39.265284+0000","last_peered":"2024-05-10T03:53:39.265284+0000","last_clean":"2024-05-10T03:53:39.265284+0000","last_became_active":"2024-05-10T03:53:38.279318+0000","last_became_peered":"2024-05-10T03:53:38.279318+0000","last_unstale":"2024-05-10T03:53:39.265284+0000","last_undegraded":"2024-05-10T03:53:39.265284+0000","last_fullsized":"2024-05-10T03:53:39.265284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:24:01.678372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265488+0000","last_change":"2024-05-10T03:53:37.278311+0000","last_active":"2024-05-10T03:53:39.265488+0000","last_peered":"2024-05-10T03:53:39.265488+0000","last_clean":"2024-05-10T03:53:39.265488+0000","last_became_active":"2024-05-10T03:53:37.277423+0000","last_became_peered":"2024-05-10T03:53:37.277423+0000","last_unstale":"2024-05-10T03:53:39.265488+0000","last_undegraded":"2024-05-10T03:53:39.265488+0000","last_fullsized":"2024-05-10T03:53:39.265488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740780+0000","last_change":"2024-05-10T03:53:38.290232+0000","last_active":"2024-05-10T03:53:39.740780+0000","last_peered":"2024-05-10T03:53:39.740780+0000","last_clean":"2024-05-10T03:53:39.740780+0000","last_became_active":"2024-05-10T03:53:38.289945+0000","last_became_peered":"2024-05-10T03:53:38.289945+0000","last_unstale":"2024-05-10T03:53:39.740780+0000","last_undegraded":"2024-05-10T03:53:39.740780+0000","last_fullsized":"2024-05-10T03:53:39.740780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:58:35.962822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282115+0000","last_change":"2024-05-10T03:53:37.285666+0000","last_active":"2024-05-10T03:53:39.282115+0000","last_peered":"2024-05-10T03:53:39.282115+0000","last_clean":"2024-05-10T03:53:39.282115+0000","last_became_active":"2024-05-10T03:53:37.285336+0000","last_became_peered":"2024-05-10T03:53:37.285336+0000","last_unstale":"2024-05-10T03:53:39.282115+0000","last_undegraded":"2024-05-10T03:53:39.282115+0000","last_fullsized":"2024-05-10T03:53:39.282115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:13.934297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740024+0000","last_change":"2024-05-10T03:53:38.277345+0000","last_active":"2024-05-10T03:53:39.740024+0000","last_peered":"2024-05-10T03:53:39.740024+0000","last_clean":"2024-05-10T03:53:39.740024+0000","last_became_active":"2024-05-10T03:53:38.273372+0000","last_became_peered":"2024-05-10T03:53:38.273372+0000","last_unstale":"2024-05-10T03:53:39.740024+0000","last_undegraded":"2024-05-10T03:53:39.740024+0000","last_fullsized":"2024-05-10T03:53:39.740024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739148+0000","last_change":"2024-05-10T03:53:37.285895+0000","last_active":"2024-05-10T03:53:39.739148+0000","last_peered":"2024-05-10T03:53:39.739148+0000","last_clean":"2024-05-10T03:53:39.739148+0000","last_became_active":"2024-05-10T03:53:37.285166+0000","last_became_peered":"2024-05-10T03:53:37.285166+0000","last_unstale":"2024-05-10T03:53:39.739148+0000","last_undegraded":"2024-05-10T03:53:39.739148+0000","last_fullsized":"2024-05-10T03:53:39.739148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265162+0000","last_change":"2024-05-10T03:53:38.271356+0000","last_active":"2024-05-10T03:53:39.265162+0000","last_peered":"2024-05-10T03:53:39.265162+0000","last_clean":"2024-05-10T03:53:39.265162+0000","last_became_active":"2024-05-10T03:53:38.271041+0000","last_became_peered":"2024-05-10T03:53:38.271041+0000","last_unstale":"2024-05-10T03:53:39.265162+0000","last_undegraded":"2024-05-10T03:53:39.265162+0000","last_fullsized":"2024-05-10T03:53:39.265162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:02.308236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265262+0000","last_change":"2024-05-10T03:53:37.282694+0000","last_active":"2024-05-10T03:53:39.265262+0000","last_peered":"2024-05-10T03:53:39.265262+0000","last_clean":"2024-05-10T03:53:39.265262+0000","last_became_active":"2024-05-10T03:53:37.282398+0000","last_became_peered":"2024-05-10T03:53:37.282398+0000","last_unstale":"2024-05-10T03:53:39.265262+0000","last_undegraded":"2024-05-10T03:53:39.265262+0000","last_fullsized":"2024-05-10T03:53:39.265262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740183+0000","last_change":"2024-05-10T03:53:38.283634+0000","last_active":"2024-05-10T03:53:39.740183+0000","last_peered":"2024-05-10T03:53:39.740183+0000","last_clean":"2024-05-10T03:53:39.740183+0000","last_became_active":"2024-05-10T03:53:38.283346+0000","last_became_peered":"2024-05-10T03:53:38.283346+0000","last_unstale":"2024-05-10T03:53:39.740183+0000","last_undegraded":"2024-05-10T03:53:39.740183+0000","last_fullsized":"2024-05-10T03:53:39.740183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:01:19.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.265349+0000","last_change":"2024-05-10T03:53:37.284973+0000","last_active":"2024-05-10T03:53:39.265349+0000","last_peered":"2024-05-10T03:53:39.265349+0000","last_clean":"2024-05-10T03:53:39.265349+0000","last_became_active":"2024-05-10T03:53:37.284626+0000","last_became_peered":"2024-05-10T03:53:37.284626+0000","last_unstale":"2024-05-10T03:53:39.265349+0000","last_undegraded":"2024-05-10T03:53:39.265349+0000","last_fullsized":"2024-05-10T03:53:39.265349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:58:45.024108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740534+0000","last_change":"2024-05-10T03:53:38.283122+0000","last_active":"2024-05-10T03:53:39.740534+0000","last_peered":"2024-05-10T03:53:39.740534+0000","last_clean":"2024-05-10T03:53:39.740534+0000","last_became_active":"2024-05-10T03:53:38.282829+0000","last_became_peered":"2024-05-10T03:53:38.282829+0000","last_unstale":"2024-05-10T03:53:39.740534+0000","last_undegraded":"2024-05-10T03:53:39.740534+0000","last_fullsized":"2024-05-10T03:53:39.740534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:19.203448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739663+0000","last_change":"2024-05-10T03:53:37.287211+0000","last_active":"2024-05-10T03:53:39.739663+0000","last_peered":"2024-05-10T03:53:39.739663+0000","last_clean":"2024-05-10T03:53:39.739663+0000","last_became_active":"2024-05-10T03:53:37.286463+0000","last_became_peered":"2024-05-10T03:53:37.286463+0000","last_unstale":"2024-05-10T03:53:39.739663+0000","last_undegraded":"2024-05-10T03:53:39.739663+0000","last_fullsized":"2024-05-10T03:53:39.739663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:47:38.357292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.282013+0000","last_change":"2024-05-10T03:53:38.287504+0000","last_active":"2024-05-10T03:53:39.282013+0000","last_peered":"2024-05-10T03:53:39.282013+0000","last_clean":"2024-05-10T03:53:39.282013+0000","last_became_active":"2024-05-10T03:53:38.287245+0000","last_became_peered":"2024-05-10T03:53:38.287245+0000","last_unstale":"2024-05-10T03:53:39.282013+0000","last_undegraded":"2024-05-10T03:53:39.282013+0000","last_fullsized":"2024-05-10T03:53:39.282013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:06:41.161562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264216+0000","last_change":"2024-05-10T03:53:38.282467+0000","last_active":"2024-05-10T03:53:39.264216+0000","last_peered":"2024-05-10T03:53:39.264216+0000","last_clean":"2024-05-10T03:53:39.264216+0000","last_became_active":"2024-05-10T03:53:38.282177+0000","last_became_peered":"2024-05-10T03:53:38.282177+0000","last_unstale":"2024-05-10T03:53:39.264216+0000","last_undegraded":"2024-05-10T03:53:39.264216+0000","last_fullsized":"2024-05-10T03:53:39.264216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739507+0000","last_change":"2024-05-10T03:53:37.285594+0000","last_active":"2024-05-10T03:53:39.739507+0000","last_peered":"2024-05-10T03:53:39.739507+0000","last_clean":"2024-05-10T03:53:39.739507+0000","last_became_active":"2024-05-10T03:53:37.285243+0000","last_became_peered":"2024-05-10T03:53:37.285243+0000","last_unstale":"2024-05-10T03:53:39.739507+0000","last_undegraded":"2024-05-10T03:53:39.739507+0000","last_fullsized":"2024-05-10T03:53:39.739507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:01.296954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.264617+0000","last_change":"2024-05-10T03:53:38.287053+0000","last_active":"2024-05-10T03:53:39.264617+0000","last_peered":"2024-05-10T03:53:39.264617+0000","last_clean":"2024-05-10T03:53:39.264617+0000","last_became_active":"2024-05-10T03:53:38.286767+0000","last_became_peered":"2024-05-10T03:53:38.286767+0000","last_unstale":"2024-05-10T03:53:39.264617+0000","last_undegraded":"2024-05-10T03:53:39.264617+0000","last_fullsized":"2024-05-10T03:53:39.264617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:37.360215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.739812+0000","last_change":"2024-05-10T03:53:37.286331+0000","last_active":"2024-05-10T03:53:39.739812+0000","last_peered":"2024-05-10T03:53:39.739812+0000","last_clean":"2024-05-10T03:53:39.739812+0000","last_became_active":"2024-05-10T03:53:37.285762+0000","last_became_peered":"2024-05-10T03:53:37.285762+0000","last_unstale":"2024-05-10T03:53:39.739812+0000","last_undegraded":"2024-05-10T03:53:39.739812+0000","last_fullsized":"2024-05-10T03:53:39.739812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:05.597162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740006+0000","last_change":"2024-05-10T03:53:38.281054+0000","last_active":"2024-05-10T03:53:39.740006+0000","last_peered":"2024-05-10T03:53:39.740006+0000","last_clean":"2024-05-10T03:53:39.740006+0000","last_became_active":"2024-05-10T03:53:38.280762+0000","last_became_peered":"2024-05-10T03:53:38.280762+0000","last_unstale":"2024-05-10T03:53:39.740006+0000","last_undegraded":"2024-05-10T03:53:39.740006+0000","last_fullsized":"2024-05-10T03:53:39.740006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:28:10.050563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740638+0000","last_change":"2024-05-10T03:53:37.282942+0000","last_active":"2024-05-10T03:53:39.740638+0000","last_peered":"2024-05-10T03:53:39.740638+0000","last_clean":"2024-05-10T03:53:39.740638+0000","last_became_active":"2024-05-10T03:53:37.282626+0000","last_became_peered":"2024-05-10T03:53:37.282626+0000","last_unstale":"2024-05-10T03:53:39.740638+0000","last_undegraded":"2024-05-10T03:53:39.740638+0000","last_fullsized":"2024-05-10T03:53:39.740638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:31:59.446264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740557+0000","last_change":"2024-05-10T03:53:38.285034+0000","last_active":"2024-05-10T03:53:39.740557+0000","last_peered":"2024-05-10T03:53:39.740557+0000","last_clean":"2024-05-10T03:53:39.740557+0000","last_became_active":"2024-05-10T03:53:38.284756+0000","last_became_peered":"2024-05-10T03:53:38.284756+0000","last_unstale":"2024-05-10T03:53:39.740557+0000","last_undegraded":"2024-05-10T03:53:39.740557+0000","last_fullsized":"2024-05-10T03:53:39.740557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:37.248548+0000","last_clean_scrub_stamp":"2024-05-10T03:53:37.248548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:01.238143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T03:53:39.740208+0000","last_change":"2024-05-10T03:53:37.287372+0000","last_active":"2024-05-10T03:53:39.740208+0000","last_peered":"2024-05-10T03:53:39.740208+0000","last_clean":"2024-05-10T03:53:39.740208+0000","last_became_active":"2024-05-10T03:53:37.286978+0000","last_became_peered":"2024-05-10T03:53:37.286978+0000","last_unstale":"2024-05-10T03:53:39.740208+0000","last_undegraded":"2024-05-10T03:53:39.740208+0000","last_fullsized":"2024-05-10T03:53:39.740208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:36.237266+0000","last_clean_scrub_stamp":"2024-05-10T03:53:36.237266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:26.382537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":802816,"data_stored":661498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":70708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":811008,"data_stored":661554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:53:51.799 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T03:53:51.799 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T03:53:51.799 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T03:53:51.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T03:53:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.935+0000 7f6c6d415640 1 Processor -- start 2024-05-10T03:53:51.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.935+0000 7f6c6d415640 1 -- start start 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c6d415640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c6815f830 0x7f6c680b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c6d415640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 0x7f6c680d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c6d415640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c680b5da0 con 0x7f6c6815f450 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c6d415640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f6c68163460 con 0x7f6c6815f830 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c6d415640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6c680b6080 con 0x7f6c680b5740 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c677fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 0x7f6c680d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c667fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c6815f830 0x7f6c680b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c677fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 0x7f6c680d5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49956/0 (socket says 172.21.15.55:49956) 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c677fe640 1 -- 172.21.15.55:0/2943739975 learned_addr learned my addr 172.21.15.55:0/2943739975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c667fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c6815f830 0x7f6c680b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:39776/0 (socket says 172.21.15.55:39776) 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c667fc640 1 -- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 msgr2=0x7f6c680d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c667fc640 1 --2- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 0x7f6c680d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c667fc640 1 -- 172.21.15.55:0/2943739975 >> v1:172.21.15.64:6789/0 conn(0x7f6c6815f450 legacy=0x7f6c680cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c667fc640 1 -- 172.21.15.55:0/2943739975 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c680d3020 con 0x7f6c6815f830 2024-05-10T03:53:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.936+0000 7f6c677fe640 1 --2- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 0x7f6c680d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.937+0000 7f6c667fc640 1 --2- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c680b5200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0097a0 tx=0x7f6c5c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b512d9d9fcf04df1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.937+0000 7f6c65ffb640 1 -- 172.21.15.55:0/2943739975 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c037070 con 0x7f6c6815f830 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.937+0000 7f6c65ffb640 1 -- 172.21.15.55:0/2943739975 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c032440 con 0x7f6c6815f830 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.937+0000 7f6c65ffb640 1 -- 172.21.15.55:0/2943739975 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c032810 con 0x7f6c6815f830 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 -- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 msgr2=0x7f6c680b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c680b5200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0097a0 tx=0x7f6c5c02a180 comp rx=0 tx=0).stop 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 -- 172.21.15.55:0/2943739975 shutdown_connections 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c680b5740 0x7f6c680d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2943739975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c680b5200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 -- 172.21.15.55:0/2943739975 >> 172.21.15.55:0/2943739975 conn(0x7f6c6808ec90 msgr2=0x7f6c6809e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 -- 172.21.15.55:0/2943739975 shutdown_connections 2024-05-10T03:53:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.938+0000 7f6c6d415640 1 -- 172.21.15.55:0/2943739975 wait complete. 2024-05-10T03:53:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.939+0000 7f6c6d415640 1 Processor -- start 2024-05-10T03:53:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.939+0000 7f6c6d415640 1 -- start start 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c6d415640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 0x7f6c68157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c6d415640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c6815f450 0x7f6c680cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c6d415640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c6815cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c6d415640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6c680d57a0 con 0x7f6c680b5740 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c6d415640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6c680d0580 con 0x7f6c6815f830 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c6d415640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6c680d5920 con 0x7f6c6815f450 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 0x7f6c68157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 0x7f6c68157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57098/0 (socket says 172.21.15.55:57098) 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 -- 172.21.15.55:0/2054316173 learned_addr learned my addr 172.21.15.55:0/2054316173 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c677fe640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c6815cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c667fc640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c6815f450 0x7f6c680cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 -- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c6815f450 msgr2=0x7f6c680cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c6815f450 0x7f6c680cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 -- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 msgr2=0x7f6c6815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c6815cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.940+0000 7f6c66ffd640 1 -- 172.21.15.55:0/2054316173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c680c8ea0 con 0x7f6c680b5740 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.941+0000 7f6c66ffd640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 0x7f6c68157700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800c450 tx=0x7f6c5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.941+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c580052d0 con 0x7f6c680b5740 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.941+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58005470 con 0x7f6c680b5740 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.941+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58012870 con 0x7f6c680b5740 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.941+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c680c9180 con 0x7f6c680b5740 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.941+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c680c9740 con 0x7f6c680b5740 2024-05-10T03:53:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.942+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6806a7e0 con 0x7f6c680b5740 2024-05-10T03:53:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.943+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c58012a10 con 0x7f6c680b5740 2024-05-10T03:53:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.943+0000 7f6c4f7fe640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6c540762d0 0x7f6c54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.943+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c58097200 con 0x7f6c680b5740 2024-05-10T03:53:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.943+0000 7f6c667fc640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6c540762d0 0x7f6c54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.944+0000 7f6c667fc640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6c540762d0 0x7f6c54078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c034000 tx=0x7f6c5c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:51.947+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c58060b70 con 0x7f6c680b5740 2024-05-10T03:53:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.178+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c680d61c0 con 0x7f6c680b5740 2024-05-10T03:53:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.178+0000 7f6c4f7fe640 1 -- 172.21.15.55:0/2054316173 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6c58060470 con 0x7f6c680b5740 2024-05-10T03:53:52.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:52.181 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6c540762d0 msgr2=0x7f6c54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6c540762d0 0x7f6c54078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c034000 tx=0x7f6c5c02e000 comp rx=0 tx=0).stop 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 msgr2=0x7f6c68157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 0x7f6c68157700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800c450 tx=0x7f6c5800c910 comp rx=0 tx=0).stop 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 shutdown_connections 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c6815f830 0x7f6c6815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c6815f450 0x7f6c680cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6c540762d0 0x7f6c54078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 --2- 172.21.15.55:0/2054316173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680b5740 0x7f6c68157700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 >> 172.21.15.55:0/2054316173 conn(0x7f6c6808ec90 msgr2=0x7f6c6806e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 shutdown_connections 2024-05-10T03:53:52.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.180+0000 7f6c6d415640 1 -- 172.21.15.55:0/2054316173 wait complete. 2024-05-10T03:53:52.194 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T03:53:52.194 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.295+0000 7f72c5c7c640 1 Processor -- start 2024-05-10T03:53:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.295+0000 7f72c5c7c640 1 -- start start 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72c5c7c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72c0162aa0 0x7f72c00d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72c5c7c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72c00d1d40 0x7f72c00d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72c5c7c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c00d3b90 con 0x7f72c00d3690 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72c5c7c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f72c00d5170 con 0x7f72c00d1d40 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72c5c7c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f72c00d3e70 con 0x7f72c0162aa0 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72c00d1d40 0x7f72c00d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72c00d1d40 0x7f72c00d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57112/0 (socket says 172.21.15.55:57112) 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 -- 172.21.15.55:0/2479594763 learned_addr learned my addr 172.21.15.55:0/2479594763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72beffd640 1 --1- 172.21.15.55:0/2479594763 >> v1:172.21.15.55:6789/0 conn(0x7f72c00d3690 0x7f72c00bac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39828/0 (socket says 172.21.15.55:39828) 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bf7fe640 1 --2- 172.21.15.55:0/2479594763 >> v2:172.21.15.64:3300/0 conn(0x7f72c0162aa0 0x7f72c00d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 -- 172.21.15.55:0/2479594763 >> v2:172.21.15.64:3300/0 conn(0x7f72c0162aa0 msgr2=0x7f72c00d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 --2- 172.21.15.55:0/2479594763 >> v2:172.21.15.64:3300/0 conn(0x7f72c0162aa0 0x7f72c00d4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 -- 172.21.15.55:0/2479594763 >> v1:172.21.15.55:6789/0 conn(0x7f72c00d3690 legacy=0x7f72c00bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bffff640 1 -- 172.21.15.55:0/2479594763 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c00d4150 con 0x7f72c00d1d40 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.296+0000 7f72bf7fe640 1 --2- 172.21.15.55:0/2479594763 >> v2:172.21.15.64:3300/0 conn(0x7f72c0162aa0 0x7f72c00d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.297+0000 7f72bffff640 1 --2- 172.21.15.55:0/2479594763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c00d1d40 0x7f72c00d21d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72c0069dd0 tx=0x7f72b802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f471ff18fe8841a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.297+0000 7f72be7fc640 1 -- 172.21.15.55:0/2479594763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8036070 con 0x7f72c00d1d40 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.297+0000 7f72be7fc640 1 -- 172.21.15.55:0/2479594763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8031600 con 0x7f72c00d1d40 2024-05-10T03:53:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.297+0000 7f72be7fc640 1 -- 172.21.15.55:0/2479594763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b80319d0 con 0x7f72c00d1d40 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 -- 172.21.15.55:0/2479594763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c00d1d40 msgr2=0x7f72c00d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/2479594763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c00d1d40 0x7f72c00d21d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72c0069dd0 tx=0x7f72b802a730 comp rx=0 tx=0).stop 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 -- 172.21.15.55:0/2479594763 shutdown_connections 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/2479594763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c00d1d40 0x7f72c00d21d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/2479594763 >> v2:172.21.15.64:3300/0 conn(0x7f72c0162aa0 0x7f72c00d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 -- 172.21.15.55:0/2479594763 >> 172.21.15.55:0/2479594763 conn(0x7f72c00740f0 msgr2=0x7f72c006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:52.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 -- 172.21.15.55:0/2479594763 shutdown_connections 2024-05-10T03:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.298+0000 7f72c5c7c640 1 -- 172.21.15.55:0/2479594763 wait complete. 2024-05-10T03:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.299+0000 7f72c5c7c640 1 Processor -- start 2024-05-10T03:53:52.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.299+0000 7f72c5c7c640 1 -- start start 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72c5c7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c00d1d40 0x7f72c0148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72c5c7c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c00d3690 0x7f72c014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72c5c7c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 0x7f72c014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72c5c7c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f72c00b8460 con 0x7f72c0162aa0 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72c5c7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72c00d4710 con 0x7f72c00d1d40 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72c5c7c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f72c00b85e0 con 0x7f72c00d3690 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 0x7f72c014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 0x7f72c014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57126/0 (socket says 172.21.15.55:57126) 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72bffff640 1 -- 172.21.15.55:0/3265237729 learned_addr learned my addr 172.21.15.55:0/3265237729 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72bf7fe640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c00d1d40 0x7f72c0148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.300+0000 7f72beffd640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c00d3690 0x7f72c014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72bffff640 1 -- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c00d3690 msgr2=0x7f72c014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72bffff640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c00d3690 0x7f72c014b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72bffff640 1 -- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c00d1d40 msgr2=0x7f72c0148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72bffff640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c00d1d40 0x7f72c0148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72bffff640 1 -- 172.21.15.55:0/3265237729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0159380 con 0x7f72c0162aa0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72bffff640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 0x7f72c014add0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009f40 tx=0x7f72b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8041020 con 0x7f72c0162aa0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b80077a0 con 0x7f72c0162aa0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8036040 con 0x7f72c0162aa0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c0145960 con 0x7f72c0162aa0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.301+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01590a0 con 0x7f72c0162aa0 2024-05-10T03:53:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.302+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c006e7a0 con 0x7f72c0162aa0 2024-05-10T03:53:52.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.303+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f72b8044020 con 0x7f72c0162aa0 2024-05-10T03:53:52.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.303+0000 7f72a7fff640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72ac0762d0 0x7f72ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.303+0000 7f72bf7fe640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72ac0762d0 0x7f72ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.303+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72b80b80f0 con 0x7f72c0162aa0 2024-05-10T03:53:52.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.304+0000 7f72bf7fe640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72ac0762d0 0x7f72ac078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72b000aac0 tx=0x7f72b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:52.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.308+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f72b804b030 con 0x7f72c0162aa0 2024-05-10T03:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.540+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72c0050820 con 0x7f72c0162aa0 2024-05-10T03:53:52.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.541+0000 7f72a7fff640 1 -- 172.21.15.55:0/3265237729 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f72b8081490 con 0x7f72c0162aa0 2024-05-10T03:53:52.544 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:52.544 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:53:52.544 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72ac0762d0 msgr2=0x7f72ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72ac0762d0 0x7f72ac078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f72b000aac0 tx=0x7f72b0008040 comp rx=0 tx=0).stop 2024-05-10T03:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 msgr2=0x7f72c014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 0x7f72c014add0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009f40 tx=0x7f72b8004a40 comp rx=0 tx=0).stop 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 shutdown_connections 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72ac0762d0 0x7f72ac078790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72c0162aa0 0x7f72c014add0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c00d3690 0x7f72c014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 --2- 172.21.15.55:0/3265237729 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c00d1d40 0x7f72c0148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 >> 172.21.15.55:0/3265237729 conn(0x7f72c00740f0 msgr2=0x7f72c00cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 shutdown_connections 2024-05-10T03:53:52.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.543+0000 7f72c5c7c640 1 -- 172.21.15.55:0/3265237729 wait complete. 2024-05-10T03:53:52.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:53:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.657+0000 7fabd0047640 1 Processor -- start 2024-05-10T03:53:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.657+0000 7fabd0047640 1 -- start start 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.658+0000 7fabd0047640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 0x7fabc815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.658+0000 7fabd0047640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc80d23c0 con 0x7fabc815cff0 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.658+0000 7fabd0047640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc80d26a0 con 0x7fabc80d3b40 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.658+0000 7fabd0047640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fabc80cde60 con 0x7fabc8070d80 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.658+0000 7fabcdde3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fabc815cff0 0x7fabc80cf380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39834/0 (socket says 172.21.15.55:39834) 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.658+0000 7fabcdde3640 1 -- 172.21.15.55:0/800577252 learned_addr learned my addr 172.21.15.55:0/800577252 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659941000 0 0) 0x7fabc80d23c0 con 0x7fabc815cff0 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabb0003520 con 0x7fabc815cff0 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabce5e4640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 0x7fabc815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 168356174 0 0) 0x7fabb0003520 con 0x7fabc815cff0 2024-05-10T03:53:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 msgr2=0x7fabc815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 0x7fabc815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 >> v1:172.21.15.64:6789/0 conn(0x7fabc80d3b40 legacy=0x7fabc8070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc80cd960 con 0x7fabc815cff0 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7fabc00016f0 con 0x7fabc815cff0 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 >> v1:172.21.15.55:6789/0 conn(0x7fabc815cff0 legacy=0x7fabc80cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb0003a30 0x7fabb0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabb0004800 0x7fabb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 0x7fabb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fabc80cde60 con 0x7fabb0003a30 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0005540 con 0x7fabb0004800 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fabb000bf00 con 0x7fabc8070d80 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcdde3640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb0003a30 0x7fabb0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabce5e4640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 0x7fabb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcd5e2640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabb0004800 0x7fabb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcdde3640 1 -- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 msgr2=0x7fabb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcdde3640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabc8070d80 0x7fabb000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcdde3640 1 -- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabb0004800 msgr2=0x7fabb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcdde3640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabb0004800 0x7fabb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.659+0000 7fabcdde3640 1 -- 172.21.15.55:0/800577252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb0003520 con 0x7fabb0003a30 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.660+0000 7fabcdde3640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb0003a30 0x7fabb0003e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fabc0001050 tx=0x7fabb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2342e5596cdd8c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.660+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0007d10 con 0x7fabb0003a30 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.660+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc0005ad0 con 0x7fabb0003a30 2024-05-10T03:53:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.660+0000 7fabccde1640 1 -- 172.21.15.55:0/800577252 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0007070 con 0x7fabb0003a30 2024-05-10T03:53:52.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabd0047640 1 -- 172.21.15.55:0/800577252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb0003a30 msgr2=0x7fabb0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabd0047640 1 --2- 172.21.15.55:0/800577252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb0003a30 0x7fabb0003e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fabc0001050 tx=0x7fabb0005830 comp rx=0 tx=0).stop 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabce5e4640 1 -- 172.21.15.55:0/800577252 reap_dead start 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabd0047640 1 -- 172.21.15.55:0/800577252 shutdown_connections 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabd0047640 1 -- 172.21.15.55:0/800577252 >> 172.21.15.55:0/800577252 conn(0x7fabc8071f80 msgr2=0x7fabc8072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabd0047640 1 -- 172.21.15.55:0/800577252 shutdown_connections 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.661+0000 7fabd0047640 1 -- 172.21.15.55:0/800577252 wait complete. 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.662+0000 7fabd0047640 1 Processor -- start 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.662+0000 7fabd0047640 1 -- start start 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabd0047640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabb0003a30 0x7fabc80c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabd0047640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 0x7fabc8157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabd0047640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabc815a3f0 0x7fabc80d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabd0047640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fabc815d760 con 0x7fabc81f32c0 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabd0047640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fabc815d5e0 con 0x7fabc815a3f0 2024-05-10T03:53:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabd0047640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fabc815d8e0 con 0x7fabb0003a30 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 0x7fabc8157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 0x7fabc8157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57134/0 (socket says 172.21.15.55:57134) 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 -- 172.21.15.55:0/1848982997 learned_addr learned my addr 172.21.15.55:0/1848982997 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcdde3640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabb0003a30 0x7fabc80c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabce5e4640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabc815a3f0 0x7fabc80d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 -- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabb0003a30 msgr2=0x7fabc80c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabb0003a30 0x7fabc80c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 -- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabc815a3f0 msgr2=0x7fabc80d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabc815a3f0 0x7fabc80d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcd5e2640 1 -- 172.21.15.55:0/1848982997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc81e6d80 con 0x7fabc81f32c0 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.663+0000 7fabcdde3640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabb0003a30 0x7fabc80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.664+0000 7fabcd5e2640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 0x7fabc8157ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00f850 tx=0x7fabbc00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.664+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00fe40 con 0x7fabc81f32c0 2024-05-10T03:53:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.664+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc018070 con 0x7fabc81f32c0 2024-05-10T03:53:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.664+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc00d6b0 con 0x7fabc81f32c0 2024-05-10T03:53:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.664+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc81e7060 con 0x7fabc81f32c0 2024-05-10T03:53:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.664+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc8158010 con 0x7fabc81f32c0 2024-05-10T03:53:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.665+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc8071ac0 con 0x7fabc81f32c0 2024-05-10T03:53:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.666+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fabbc00d850 con 0x7fabc81f32c0 2024-05-10T03:53:52.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.666+0000 7fabc67fc640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fabb4076300 0x7fabb40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:52.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.666+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fabbc097310 con 0x7fabc81f32c0 2024-05-10T03:53:52.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.666+0000 7fabcdde3640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fabb4076300 0x7fabb40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:52.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.667+0000 7fabcdde3640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fabb4076300 0x7fabb40787c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabc0032000 tx=0x7fabc0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:52.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.671+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fabbc060c70 con 0x7fabc81f32c0 2024-05-10T03:53:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.904+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabc8050820 con 0x7fabc81f32c0 2024-05-10T03:53:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.904+0000 7fabc67fc640 1 -- 172.21.15.55:0/1848982997 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fabbc060570 con 0x7fabc81f32c0 2024-05-10T03:53:52.907 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:52.908 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:53:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fabb4076300 msgr2=0x7fabb40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fabb4076300 0x7fabb40787c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabc0032000 tx=0x7fabc0009030 comp rx=0 tx=0).stop 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 msgr2=0x7fabc8157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 0x7fabc8157ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00f850 tx=0x7fabbc00fd10 comp rx=0 tx=0).stop 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 shutdown_connections 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fabc815a3f0 0x7fabc80d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fabb4076300 0x7fabb40787c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc81f32c0 0x7fabc8157ad0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 --2- 172.21.15.55:0/1848982997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fabb0003a30 0x7fabc80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 >> 172.21.15.55:0/1848982997 conn(0x7fabc8071f80 msgr2=0x7fabc8072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 shutdown_connections 2024-05-10T03:53:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:52.907+0000 7fabd0047640 1 -- 172.21.15.55:0/1848982997 wait complete. 2024-05-10T03:53:52.921 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:53:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.021+0000 7f15a0620640 1 Processor -- start 2024-05-10T03:53:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.021+0000 7f15a0620640 1 -- start start 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f15a0620640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f159815d290 0x7f1598074210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f15a0620640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15980b69e0 0x7f159815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f15a0620640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159815d670 con 0x7f1598073ba0 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f15a0620640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f15980b3980 con 0x7f15980b69e0 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f15a0620640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f15980cdb20 con 0x7f159815d290 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159dbbb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1598073ba0 0x7f15980b62d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39840/0 (socket says 172.21.15.55:39840) 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159dbbb640 1 -- 172.21.15.55:0/2072297153 learned_addr learned my addr 172.21.15.55:0/2072297153 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159ebbd640 1 --2- 172.21.15.55:0/2072297153 >> v2:172.21.15.55:3300/0 conn(0x7f15980b69e0 0x7f159815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159e3bc640 1 --2- 172.21.15.55:0/2072297153 >> v2:172.21.15.64:3300/0 conn(0x7f159815d290 0x7f1598074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159ebbd640 1 -- 172.21.15.55:0/2072297153 >> v2:172.21.15.64:3300/0 conn(0x7f159815d290 msgr2=0x7f1598074210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159ebbd640 1 --2- 172.21.15.55:0/2072297153 >> v2:172.21.15.64:3300/0 conn(0x7f159815d290 0x7f1598074210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159ebbd640 1 -- 172.21.15.55:0/2072297153 >> v1:172.21.15.55:6789/0 conn(0x7f1598073ba0 legacy=0x7f15980b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.022+0000 7f159ebbd640 1 -- 172.21.15.55:0/2072297153 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15980cde00 con 0x7f15980b69e0 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.023+0000 7f159ebbd640 1 --2- 172.21.15.55:0/2072297153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980b69e0 0x7f159815db00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15980b71d0 tx=0x7f159002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ce1e74672bda33 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.023+0000 7f159d3ba640 1 -- 172.21.15.55:0/2072297153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590007740 con 0x7f15980b69e0 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.023+0000 7f159d3ba640 1 -- 172.21.15.55:0/2072297153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15900078e0 con 0x7f15980b69e0 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.023+0000 7f159d3ba640 1 -- 172.21.15.55:0/2072297153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590007cb0 con 0x7f15980b69e0 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 -- 172.21.15.55:0/2072297153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980b69e0 msgr2=0x7f159815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 --2- 172.21.15.55:0/2072297153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980b69e0 0x7f159815db00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15980b71d0 tx=0x7f159002a5f0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 -- 172.21.15.55:0/2072297153 shutdown_connections 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 --2- 172.21.15.55:0/2072297153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980b69e0 0x7f159815db00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 --2- 172.21.15.55:0/2072297153 >> v2:172.21.15.64:3300/0 conn(0x7f159815d290 0x7f1598074210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 -- 172.21.15.55:0/2072297153 >> 172.21.15.55:0/2072297153 conn(0x7f15980b2cc0 msgr2=0x7f15980b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 -- 172.21.15.55:0/2072297153 shutdown_connections 2024-05-10T03:53:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.024+0000 7f15a0620640 1 -- 172.21.15.55:0/2072297153 wait complete. 2024-05-10T03:53:53.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.025+0000 7f15a0620640 1 Processor -- start 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.025+0000 7f15a0620640 1 -- start start 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 0x7f159814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15980b69e0 0x7f15981f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159815d290 0x7f15981537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f159815e1c0 con 0x7f1598073ba0 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f159815e040 con 0x7f159815d290 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f159815e340 con 0x7f15980b69e0 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 0x7f159814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 0x7f159814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57152/0 (socket says 172.21.15.55:57152) 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 -- 172.21.15.55:0/902720202 learned_addr learned my addr 172.21.15.55:0/902720202 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159ebbd640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159815d290 0x7f15981537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159dbbb640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15980b69e0 0x7f15981f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 -- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15980b69e0 msgr2=0x7f15981f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15980b69e0 0x7f15981f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 -- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159815d290 msgr2=0x7f15981537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159815d290 0x7f15981537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 -- 172.21.15.55:0/902720202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15981f3930 con 0x7f1598073ba0 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159dbbb640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15980b69e0 0x7f15981f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f159e3bc640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 0x7f159814db50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f159400e8a0 tx=0x7f159400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594017070 con 0x7f1598073ba0 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159400c8e0 con 0x7f1598073ba0 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15981f3c10 con 0x7f1598073ba0 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159400ccd0 con 0x7f1598073ba0 2024-05-10T03:53:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.026+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159814e090 con 0x7f1598073ba0 2024-05-10T03:53:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.027+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159806f450 con 0x7f1598073ba0 2024-05-10T03:53:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.028+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f159401a070 con 0x7f1598073ba0 2024-05-10T03:53:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.029+0000 7f158effd640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f157c0762d0 0x7f157c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.029+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1594097450 con 0x7f1598073ba0 2024-05-10T03:53:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.029+0000 7f159dbbb640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f157c0762d0 0x7f157c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.029+0000 7f159dbbb640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f157c0762d0 0x7f157c078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f159815f730 tx=0x7f1588009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.033+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f15940606c0 con 0x7f1598073ba0 2024-05-10T03:53:53.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.224+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1598050820 con 0x7f1598073ba0 2024-05-10T03:53:53.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.226+0000 7f158effd640 1 -- 172.21.15.55:0/902720202 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7f15940649c0 con 0x7f1598073ba0 2024-05-10T03:53:53.229 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:53.229 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f157c0762d0 msgr2=0x7f157c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f157c0762d0 0x7f157c078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f159815f730 tx=0x7f1588009040 comp rx=0 tx=0).stop 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 msgr2=0x7f159814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 0x7f159814db50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f159400e8a0 tx=0x7f159400ed60 comp rx=0 tx=0).stop 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 shutdown_connections 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f159815d290 0x7f15981537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15980b69e0 0x7f15981f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f157c0762d0 0x7f157c078790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 --2- 172.21.15.55:0/902720202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1598073ba0 0x7f159814db50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 >> 172.21.15.55:0/902720202 conn(0x7f15980b2cc0 msgr2=0x7f1598151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:53.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 shutdown_connections 2024-05-10T03:53:53.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.228+0000 7f15a0620640 1 -- 172.21.15.55:0/902720202 wait complete. 2024-05-10T03:53:53.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:53:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.344+0000 7f86e1ecf640 1 Processor -- start 2024-05-10T03:53:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.344+0000 7f86e1ecf640 1 -- start start 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.344+0000 7f86e1ecf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86dc15cff0 0x7f86dc0d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.344+0000 7f86e1ecf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86dc0d23c0 con 0x7f86dc15d3d0 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.344+0000 7f86e1ecf640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86dc0d26a0 con 0x7f86dc070670 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.344+0000 7f86e1ecf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f86dc0cde60 con 0x7f86dc15cff0 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86db7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86dc15cff0 0x7f86dc0d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86db7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86dc15cff0 0x7f86dc0d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57160/0 (socket says 172.21.15.55:57160) 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86daffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86dc15d3d0 0x7f86dc0cf380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39852/0 (socket says 172.21.15.55:39852) 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86db7fe640 1 -- 172.21.15.55:0/4052534402 learned_addr learned my addr 172.21.15.55:0/4052534402 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86db7fe640 1 -- 172.21.15.55:0/4052534402 >> v1:172.21.15.64:6789/0 conn(0x7f86dc070670 legacy=0x7f86dc160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86db7fe640 1 -- 172.21.15.55:0/4052534402 >> v1:172.21.15.55:6789/0 conn(0x7f86dc15d3d0 legacy=0x7f86dc0cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.345+0000 7f86db7fe640 1 -- 172.21.15.55:0/4052534402 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc0cd960 con 0x7f86dc15cff0 2024-05-10T03:53:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86db7fe640 1 --2- 172.21.15.55:0/4052534402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc15cff0 0x7f86dc0d3b40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a45f613e559042 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86da7fc640 1 -- 172.21.15.55:0/4052534402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4037070 con 0x7f86dc15cff0 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86da7fc640 1 -- 172.21.15.55:0/4052534402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c4032440 con 0x7f86dc15cff0 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86da7fc640 1 -- 172.21.15.55:0/4052534402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4032810 con 0x7f86dc15cff0 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 -- 172.21.15.55:0/4052534402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc15cff0 msgr2=0x7f86dc0d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/4052534402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc15cff0 0x7f86dc0d3b40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c402a270 comp rx=0 tx=0).stop 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 -- 172.21.15.55:0/4052534402 shutdown_connections 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/4052534402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc15cff0 0x7f86dc0d3b40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 -- 172.21.15.55:0/4052534402 >> 172.21.15.55:0/4052534402 conn(0x7f86dc071f80 msgr2=0x7f86dc072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 -- 172.21.15.55:0/4052534402 shutdown_connections 2024-05-10T03:53:53.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.346+0000 7f86e1ecf640 1 -- 172.21.15.55:0/4052534402 wait complete. 2024-05-10T03:53:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.348+0000 7f86e1ecf640 1 Processor -- start 2024-05-10T03:53:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.348+0000 7f86e1ecf640 1 -- start start 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86e1ecf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 0x7f86dc1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86e1ecf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86dc15cff0 0x7f86dc15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86e1ecf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86dc15d3d0 0x7f86dc0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86e1ecf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc070c80 con 0x7f86dc070670 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86e1ecf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc070b00 con 0x7f86dc15d3d0 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86e1ecf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f86dc070e00 con 0x7f86dc15cff0 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 0x7f86dc1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 0x7f86dc1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57172/0 (socket says 172.21.15.55:57172) 2024-05-10T03:53:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 -- 172.21.15.55:0/516317466 learned_addr learned my addr 172.21.15.55:0/516317466 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86daffd640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86dc15cff0 0x7f86dc15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86dbfff640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86dc15d3d0 0x7f86dc0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 -- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86dc15cff0 msgr2=0x7f86dc15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86dc15cff0 0x7f86dc15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 -- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86dc15d3d0 msgr2=0x7f86dc0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86dc15d3d0 0x7f86dc0c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 -- 172.21.15.55:0/516317466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc158260 con 0x7f86dc070670 2024-05-10T03:53:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.349+0000 7f86db7fe640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 0x7f86dc1537f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.350+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4041020 con 0x7f86dc070670 2024-05-10T03:53:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.350+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c4030970 con 0x7f86dc070670 2024-05-10T03:53:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.350+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc158540 con 0x7f86dc070670 2024-05-10T03:53:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.350+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4037040 con 0x7f86dc070670 2024-05-10T03:53:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.350+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc158b00 con 0x7f86dc070670 2024-05-10T03:53:53.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.351+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc071ac0 con 0x7f86dc070670 2024-05-10T03:53:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.352+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f86c4044020 con 0x7f86dc070670 2024-05-10T03:53:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.352+0000 7f86d3fff640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f86bc0762d0 0x7f86bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.352+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f86c40b7f30 con 0x7f86dc070670 2024-05-10T03:53:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.352+0000 7f86daffd640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f86bc0762d0 0x7f86bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:53.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.353+0000 7f86daffd640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f86bc0762d0 0x7f86bc078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86dc06e520 tx=0x7f86cc000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.357+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f86c404b030 con 0x7f86dc070670 2024-05-10T03:53:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.589+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86dc050820 con 0x7f86dc070670 2024-05-10T03:53:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.590+0000 7f86d3fff640 1 -- 172.21.15.55:0/516317466 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f86c4081240 con 0x7f86dc070670 2024-05-10T03:53:53.593 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:53:53.593 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:53:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:53:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f86bc0762d0 msgr2=0x7f86bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f86bc0762d0 0x7f86bc078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86dc06e520 tx=0x7f86cc000bc0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 msgr2=0x7f86dc1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 0x7f86dc1537f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c40046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 shutdown_connections 2024-05-10T03:53:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86dc15d3d0 0x7f86dc0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86dc15cff0 0x7f86dc15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f86bc0762d0 0x7f86bc078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 --2- 172.21.15.55:0/516317466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86dc070670 0x7f86dc1537f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 >> 172.21.15.55:0/516317466 conn(0x7f86dc071f80 msgr2=0x7f86dc1603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 shutdown_connections 2024-05-10T03:53:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:53.592+0000 7f86e1ecf640 1 -- 172.21.15.55:0/516317466 wait complete. 2024-05-10T03:53:54.009 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T03:53:37.640203+0000', 'modified': '2024-05-10T03:53:40.655297+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6835/1222315880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6833', 'nonce': 1222315880}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 1222315880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-05-10T03:53:54.009 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T03:53:54.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T03:53:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.114+0000 7f3e75de4640 1 Processor -- start 2024-05-10T03:53:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e75de4640 1 -- start start 2024-05-10T03:53:54.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e75de4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e7015f410 0x7f3e700d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e75de4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e7006d4a0 0x7f3e700d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e75de4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7006d900 con 0x7f3e700d34e0 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e75de4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f3e700b4960 con 0x7f3e7006d4a0 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e75de4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3e700d3930 con 0x7f3e7015f410 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e6effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e7006d4a0 0x7f3e700d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e6effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e7006d4a0 0x7f3e700d2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57182/0 (socket says 172.21.15.55:57182) 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.115+0000 7f3e6effd640 1 -- 172.21.15.55:0/183843762 learned_addr learned my addr 172.21.15.55:0/183843762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.116+0000 7f3e6effd640 1 -- 172.21.15.55:0/183843762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e7015f410 msgr2=0x7f3e700d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.116+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/183843762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e7015f410 0x7f3e700d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.116+0000 7f3e6effd640 1 --2- 172.21.15.55:0/183843762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e7015f410 0x7f3e700d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.116+0000 7f3e6effd640 1 -- 172.21.15.55:0/183843762 >> v1:172.21.15.64:6789/0 conn(0x7f3e700d34e0 legacy=0x7f3e700cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.116+0000 7f3e6effd640 1 -- 172.21.15.55:0/183843762 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e700d1750 con 0x7f3e7006d4a0 2024-05-10T03:53:54.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.116+0000 7f3e6effd640 1 --2- 172.21.15.55:0/183843762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7006d4a0 0x7f3e700d2fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e6402a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8e5851e459d75f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e6e7fc640 1 -- 172.21.15.55:0/183843762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64037070 con 0x7f3e7006d4a0 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e6e7fc640 1 -- 172.21.15.55:0/183843762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64032440 con 0x7f3e7006d4a0 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e6e7fc640 1 -- 172.21.15.55:0/183843762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64032810 con 0x7f3e7006d4a0 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 -- 172.21.15.55:0/183843762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7006d4a0 msgr2=0x7f3e700d2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 --2- 172.21.15.55:0/183843762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7006d4a0 0x7f3e700d2fa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009870 tx=0x7f3e6402a120 comp rx=0 tx=0).stop 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 -- 172.21.15.55:0/183843762 shutdown_connections 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 --2- 172.21.15.55:0/183843762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7006d4a0 0x7f3e700d2fa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 --2- 172.21.15.55:0/183843762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e7015f410 0x7f3e700d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 -- 172.21.15.55:0/183843762 >> 172.21.15.55:0/183843762 conn(0x7f3e7009ba60 msgr2=0x7f3e7009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 -- 172.21.15.55:0/183843762 shutdown_connections 2024-05-10T03:53:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.117+0000 7f3e75de4640 1 -- 172.21.15.55:0/183843762 wait complete. 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.118+0000 7f3e75de4640 1 Processor -- start 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 -- start start 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e7006d4a0 0x7f3e700cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e700d34e0 0x7f3e700b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 0x7f3e700cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3e700d1ff0 con 0x7f3e7015f410 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e700d1d10 con 0x7f3e7006d4a0 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e75de4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3e700d22d0 con 0x7f3e700d34e0 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 0x7f3e700cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 0x7f3e700cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57196/0 (socket says 172.21.15.55:57196) 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.119+0000 7f3e6ffff640 1 -- 172.21.15.55:0/4074646244 learned_addr learned my addr 172.21.15.55:0/4074646244 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e7006d4a0 0x7f3e700cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6effd640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e700d34e0 0x7f3e700b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6ffff640 1 -- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e700d34e0 msgr2=0x7f3e700b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e700d34e0 0x7f3e700b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6ffff640 1 -- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e7006d4a0 msgr2=0x7f3e700cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e7006d4a0 0x7f3e700cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6ffff640 1 -- 172.21.15.55:0/4074646244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e700b72b0 con 0x7f3e7015f410 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e7006d4a0 0x7f3e700cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6effd640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e700d34e0 0x7f3e700b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 0x7f3e700cccb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c7b0 tx=0x7f3e6800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e57fff640 1 -- 172.21.15.55:0/4074646244 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68004b60 con 0x7f3e7015f410 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e57fff640 1 -- 172.21.15.55:0/4074646244 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e68004d00 con 0x7f3e7015f410 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e700b7590 con 0x7f3e7015f410 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e57fff640 1 -- 172.21.15.55:0/4074646244 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800aa90 con 0x7f3e7015f410 2024-05-10T03:53:54.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.120+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e700ca650 con 0x7f3e7015f410 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.122+0000 7f3e57fff640 1 -- 172.21.15.55:0/4074646244 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e6800ac30 con 0x7f3e7015f410 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.123+0000 7f3e57fff640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e5c0762d0 0x7f3e5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.123+0000 7f3e57fff640 1 -- 172.21.15.55:0/4074646244 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e68097ac0 con 0x7f3e7015f410 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.123+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e5c0762d0 0x7f3e5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.123+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e5c0762d0 0x7f3e5c078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e70162200 tx=0x7f3e60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.123+0000 7f3e78bd9740 1 Processor -- start 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 -- start start 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d17ec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17bcbb0 0x5605d17c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x5605d17268d0 con 0x5605d17e9f50 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5605d16dfc10 con 0x5605d17ea330 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x5605d1722890 con 0x5605d17bcbb0 2024-05-10T03:53:54.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e6f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d17ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e6f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d17ec760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57212/0 (socket says 172.21.15.55:57212) 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.124+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/4237148492 learned_addr learned my addr 172.21.15.55:0/4237148492 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17bcbb0 msgr2=0x5605d17c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6effd640 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17bcbb0 0x5605d17c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 msgr2=0x5605d17ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17ecca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/4237148492 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d16e75d0 con 0x5605d17e9f50 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6effd640 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d17ec760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000dad0 tx=0x7f3e60010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd56dcd0ee1e3af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e557fa640 1 -- 172.21.15.55:0/4237148492 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60019050 con 0x5605d17e9f50 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e557fa640 1 -- 172.21.15.55:0/4237148492 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e60023070 con 0x5605d17e9f50 2024-05-10T03:53:54.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.125+0000 7f3e557fa640 1 -- 172.21.15.55:0/4237148492 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60012dc0 con 0x5605d17e9f50 2024-05-10T03:53:54.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 -- 172.21.15.55:0/4237148492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 msgr2=0x5605d17ec760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d17ec760 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000dad0 tx=0x7f3e60010000 comp rx=0 tx=0).stop 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 -- 172.21.15.55:0/4237148492 shutdown_connections 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17bcbb0 0x5605d17c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/4237148492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d17ec760 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 -- 172.21.15.55:0/4237148492 >> 172.21.15.55:0/4237148492 conn(0x5605d17bee20 msgr2=0x5605d1807760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 -- 172.21.15.55:0/4237148492 shutdown_connections 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 -- 172.21.15.55:0/4237148492 wait complete. 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.126+0000 7f3e78bd9740 1 -- start start 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 Processor -- start 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17e9f50 0x5605d17e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17ea330 0x5605d17dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d17edc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x5605d17c1fd0 con 0x5605d17f0080 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5605d16e3760 con 0x5605d17e9f50 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x5605d17c22b0 con 0x5605d17ea330 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e78bd9740 10 client.0 _ll_register_callbacks cb 0x5605d171ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.127+0000 7f3e6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d17edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d17edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57226/0 (socket says 172.21.15.55:57226) 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 -- 172.21.15.55:0/374092998 learned_addr learned my addr 172.21.15.55:0/374092998 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6effd640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17ea330 0x5605d17dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17e9f50 0x5605d17e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 -- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17ea330 msgr2=0x5605d17dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17ea330 0x5605d17dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 -- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17e9f50 msgr2=0x5605d17e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17e9f50 0x5605d17e03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 -- 172.21.15.55:0/374092998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d14382d0 con 0x5605d17f0080 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d17edc30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e6805ce30 tx=0x7f3e68060980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bef26f6941cdc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-10T03:53:54.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/374092998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68077070 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/374092998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e680698f0 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e60023070 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/374092998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f3e68065160 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e78bd9740 10 client.4608 fetch_fsmap learned FSMap version 8 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5605d15026b0 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/374092998 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e60023070 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.128+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/374092998 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f3e68067070 con 0x5605d17f0080 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e78bd9740 10 client.4608 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e78bd9740 10 client.4608 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e78bd9740 20 client.4608 populate_metadata read hostname 'smithi055' 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d180a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e78bd9740 4 client.4608 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 --> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605d16aa760 con 0x5605d180a370 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d180a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d180a750 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69659ddff72af71b server_cookie=518f9bda1044f546 in_seq=0 out_seq=0 2024-05-10T03:53:54.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.129+0000 7f3e4e7fc640 10 client.4608 ms_handle_connect on v2:172.21.15.64:6833/1222315880 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/374092998 <== mds.0 v2:172.21.15.64:6833/1222315880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5605d16aa760 con 0x5605d180a370 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e4e7fc640 10 client.4608 handle_command_reply: tid=0 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 client.4608 shutdown 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 msgr2=0x5605d17edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d17edc30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e6805ce30 tx=0x7f3e68060980 comp rx=0 tx=0).stop 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 shutdown_connections 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d180a750 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d17edc30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17ea330 0x5605d17dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/374092998 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17e9f50 0x5605d17e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e4e7fc640 0 client.4608 ms_handle_reset on v2:172.21.15.64:6833/1222315880 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 >> 172.21.15.55:0/374092998 conn(0x5605d17bcbb0 msgr2=0x5605d17ec720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 shutdown_connections 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 1 -- 172.21.15.55:0/374092998 wait complete. 2024-05-10T03:53:54.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.130+0000 7f3e78bd9740 20 client.4608 trim_cache size 0 max 16384 2024-05-10T03:53:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.149+0000 7f3e78bd9740 1 Processor -- start 2024-05-10T03:53:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.149+0000 7f3e78bd9740 1 -- start start 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17e9f50 0x5605d181a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d1804110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d1804650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3e70200a00 con 0x5605d17f0080 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e701f8a50 con 0x5605d17ea330 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3e702004b0 con 0x5605d17e9f50 2024-05-10T03:53:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d1804650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d1804650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57234/0 (socket says 172.21.15.55:57234) 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 -- 172.21.15.55:0/3760381282 learned_addr learned my addr 172.21.15.55:0/3760381282 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 -- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17e9f50 msgr2=0x5605d181a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17e9f50 0x5605d181a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6effd640 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d1804110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 -- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 msgr2=0x5605d1804110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d1804110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.150+0000 7f3e6ffff640 1 -- 172.21.15.55:0/3760381282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d17e1260 con 0x5605d17f0080 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e6ffff640 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d1804650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3e68060ab0 tx=0x7f3e68077000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d6ed97c3b6e0e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e54ff9640 1 -- 172.21.15.55:0/3760381282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6806e070 con 0x5605d17f0080 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e54ff9640 1 -- 172.21.15.55:0/3760381282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680696f0 con 0x5605d17f0080 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e54ff9640 1 -- 172.21.15.55:0/3760381282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68060700 con 0x5605d17f0080 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 -- 172.21.15.55:0/3760381282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 msgr2=0x5605d1804650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d1804650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3e68060ab0 tx=0x7f3e68077000 comp rx=0 tx=0).stop 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 -- 172.21.15.55:0/3760381282 shutdown_connections 2024-05-10T03:53:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17f0080 0x5605d1804650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d1804110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/3760381282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17e9f50 0x5605d181a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 -- 172.21.15.55:0/3760381282 >> 172.21.15.55:0/3760381282 conn(0x5605d17bcbb0 msgr2=0x5605d17e0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 -- 172.21.15.55:0/3760381282 shutdown_connections 2024-05-10T03:53:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.151+0000 7f3e78bd9740 1 -- 172.21.15.55:0/3760381282 wait complete. 2024-05-10T03:53:54.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.152+0000 7f3e78bd9740 1 -- start start 2024-05-10T03:53:54.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.152+0000 7f3e78bd9740 1 Processor -- start 2024-05-10T03:53:54.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d1885570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17c0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17f0080 0x5605d18860e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x5605d180afc0 con 0x5605d17e9f50 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x5605d17c1fd0 con 0x5605d17ea330 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x5605d181b7d0 con 0x5605d17f0080 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 10 client.0 _ll_register_callbacks cb 0x7f3e6805d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d1885570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d1885570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57238/0 (socket says 172.21.15.55:57238) 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/299275078 learned_addr learned my addr 172.21.15.55:0/299275078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17f0080 msgr2=0x5605d18860e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6effd640 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17f0080 0x5605d18860e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 msgr2=0x5605d17c0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17c0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 -- 172.21.15.55:0/299275078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d17fd190 con 0x5605d17e9f50 2024-05-10T03:53:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e6f7fe640 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d1885570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e60008010 tx=0x7f3e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30391965a880fc9a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/299275078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60019050 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/299275078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e60034660 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.153+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605d17efed0 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/299275078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f3e6003f050 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 10 client.4614 fetch_fsmap learned FSMap version 8 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5605d17b8190 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/299275078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5605d17efed0 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/299275078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f3e60042020 con 0x5605d17e9f50 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 10 client.4614 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 20 client.4614 populate_metadata read hostname 'smithi055' 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d1807760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 4 client.4614 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 --> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] -- command(tid 0: {"prefix": "status"}) -- 0x5605d17ef6f0 con 0x5605d180a370 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e6effd640 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d1807760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e4e7fc640 10 client.4614 ms_handle_connect on v2:172.21.15.64:6833/1222315880 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.154+0000 7f3e6effd640 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d1807760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5609db97ec878 server_cookie=8757abd0fc45f3c9 in_seq=0 out_seq=0 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e4e7fc640 1 -- 172.21.15.55:0/299275078 <== mds.0 v2:172.21.15.64:6833/1222315880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5605d17ef6f0 con 0x5605d180a370 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e4e7fc640 10 client.4614 handle_command_reply: tid=0 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 client.4614 shutdown 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 msgr2=0x5605d1885570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d1885570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e60008010 tx=0x7f3e600046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 shutdown_connections 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:6833/1222315880,v1:172.21.15.64:6835/1222315880] conn(0x5605d180a370 0x5605d1807760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5605d17f0080 0x5605d18860e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5605d17ea330 0x5605d17c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 --2- 172.21.15.55:0/299275078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5605d17e9f50 0x5605d1885570 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 >> 172.21.15.55:0/299275078 conn(0x5605d17bcbb0 msgr2=0x5605d1804110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e4e7fc640 0 client.4614 ms_handle_reset on v2:172.21.15.64:6833/1222315880 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 shutdown_connections 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 1 -- 172.21.15.55:0/299275078 wait complete. 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e78bd9740 20 client.4614 trim_cache size 0 max 16384 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "799093e3-fb07-47b3-97e4-8d13003c3bca", 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4272, 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-05-10T03:53:54.163 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 15.884097803, 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 8, 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 20, 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 20, 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 22.132169279999999 2024-05-10T03:53:54.164 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e5c0762d0 msgr2=0x7f3e5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e75de4640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e5c0762d0 0x7f3e5c078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e70162200 tx=0x7f3e60008040 comp rx=0 tx=0).stop 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 msgr2=0x7f3e700cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.155+0000 7f3e75de4640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 0x7f3e700cccb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c7b0 tx=0x7f3e6800cc70 comp rx=0 tx=0).stop 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 shutdown_connections 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e5c0762d0 0x7f3e5c078790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7015f410 0x7f3e700cccb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e700d34e0 0x7f3e700b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 --2- 172.21.15.55:0/4074646244 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e7006d4a0 0x7f3e700cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 >> 172.21.15.55:0/4074646244 conn(0x7f3e7009ba60 msgr2=0x7f3e700cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 shutdown_connections 2024-05-10T03:53:54.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.156+0000 7f3e75de4640 1 -- 172.21.15.55:0/4074646244 wait complete. 2024-05-10T03:53:54.169 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T03:53:54.179 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T03:53:54.179 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T03:53:54.180 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T03:53:54.180 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T03:53:54.243 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T03:53:54.243 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-10T03:53:54.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.243 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:53:54.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-05-10T03:53:54.327 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-05-10T03:53:54.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:53:54.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.329 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:53:54.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-05-10T03:53:54.452 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-05-10T03:53:54.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:53:54.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.454 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-05-10T03:53:54.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.474 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-05-10T03:53:54.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:53:54.551 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2024-05-10T03:53:54.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.551 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-05-10T03:53:54.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:54.610 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-05-10T03:53:54.679 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2024-05-10T03:53:54.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:53:54.681 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-10T03:53:54.681 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T03:53:54.681 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T03:53:54.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T03:53:54.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.783+0000 7fe8d6324640 1 Processor -- start 2024-05-10T03:53:54.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.783+0000 7fe8d6324640 1 -- start start 2024-05-10T03:53:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d6324640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b44c0 0x7fe8d009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d6324640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe8d00b5660 0x7fe8d009bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d6324640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d00cd7d0 con 0x7fe8d00ce590 2024-05-10T03:53:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d6324640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d00b48a0 con 0x7fe8d00b5660 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d6324640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d00cdab0 con 0x7fe8d00b44c0 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d48c1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8d00ce590 0x7fe8d00ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39862/0 (socket says 172.21.15.55:39862) 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8d48c1640 1 -- 172.21.15.55:0/3956480266 learned_addr learned my addr 172.21.15.55:0/3956480266 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cf7fe640 1 --2- 172.21.15.55:0/3956480266 >> v2:172.21.15.64:3300/0 conn(0x7fe8d00b5660 0x7fe8d009bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cffff640 1 --2- 172.21.15.55:0/3956480266 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b44c0 0x7fe8d009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8ceffd640 1 -- 172.21.15.55:0/3956480266 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225619375 0 0) 0x7fe8d00cd7d0 con 0x7fe8d00ce590 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8ceffd640 1 -- 172.21.15.55:0/3956480266 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b8003520 con 0x7fe8d00ce590 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cffff640 1 -- 172.21.15.55:0/3956480266 >> v2:172.21.15.64:3300/0 conn(0x7fe8d00b5660 msgr2=0x7fe8d009bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cffff640 1 --2- 172.21.15.55:0/3956480266 >> v2:172.21.15.64:3300/0 conn(0x7fe8d00b5660 0x7fe8d009bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cffff640 1 -- 172.21.15.55:0/3956480266 >> v1:172.21.15.55:6789/0 conn(0x7fe8d00ce590 legacy=0x7fe8d00ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cffff640 1 -- 172.21.15.55:0/3956480266 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d00cdd90 con 0x7fe8d00b44c0 2024-05-10T03:53:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.784+0000 7fe8cf7fe640 1 --2- 172.21.15.55:0/3956480266 >> v2:172.21.15.64:3300/0 conn(0x7fe8d00b5660 0x7fe8d009bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.785+0000 7fe8cffff640 1 --2- 172.21.15.55:0/3956480266 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b44c0 0x7fe8d009ba60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00097a0 tx=0x7fe8c002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67fa34aa97482baf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.785+0000 7fe8ceffd640 1 -- 172.21.15.55:0/3956480266 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0037070 con 0x7fe8d00b44c0 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.785+0000 7fe8ceffd640 1 -- 172.21.15.55:0/3956480266 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c002ae50 con 0x7fe8d00b44c0 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.785+0000 7fe8ceffd640 1 -- 172.21.15.55:0/3956480266 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0032660 con 0x7fe8d00b44c0 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 -- 172.21.15.55:0/3956480266 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b44c0 msgr2=0x7fe8d009ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 --2- 172.21.15.55:0/3956480266 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b44c0 0x7fe8d009ba60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00097a0 tx=0x7fe8c002a100 comp rx=0 tx=0).stop 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 -- 172.21.15.55:0/3956480266 shutdown_connections 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 --2- 172.21.15.55:0/3956480266 >> v2:172.21.15.64:3300/0 conn(0x7fe8d00b5660 0x7fe8d009bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 --2- 172.21.15.55:0/3956480266 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b44c0 0x7fe8d009ba60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 -- 172.21.15.55:0/3956480266 >> 172.21.15.55:0/3956480266 conn(0x7fe8d00b4b40 msgr2=0x7fe8d00b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 -- 172.21.15.55:0/3956480266 shutdown_connections 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.786+0000 7fe8d6324640 1 -- 172.21.15.55:0/3956480266 wait complete. 2024-05-10T03:53:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.787+0000 7fe8d6324640 1 Processor -- start 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.787+0000 7fe8d6324640 1 -- start start 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d6324640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 0x7fe8d00c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d6324640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b5660 0x7fe8d00a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d6324640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00ce590 0x7fe8d00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d6324640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d006e310 con 0x7fe8d00b44c0 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d6324640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d006e6b0 con 0x7fe8d00ce590 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d6324640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d006e490 con 0x7fe8d00b5660 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 0x7fe8d00c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 0x7fe8d00c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57248/0 (socket says 172.21.15.55:57248) 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8cffff640 1 -- 172.21.15.55:0/2419783463 learned_addr learned my addr 172.21.15.55:0/2419783463 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8cf7fe640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b5660 0x7fe8d00a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.788+0000 7fe8d48c1640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00ce590 0x7fe8d00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8cffff640 1 -- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b5660 msgr2=0x7fe8d00a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8cffff640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b5660 0x7fe8d00a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8cffff640 1 -- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00ce590 msgr2=0x7fe8d00ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8cffff640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00ce590 0x7fe8d00ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8cffff640 1 -- 172.21.15.55:0/2419783463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d00cae70 con 0x7fe8d00b44c0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8d48c1640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00ce590 0x7fe8d00ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8cffff640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 0x7fe8d00c7b90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0035040 tx=0x7fe8c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0041070 con 0x7fe8d00b44c0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c003c460 con 0x7fe8d00b44c0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0037040 con 0x7fe8d00b44c0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d00c8220 con 0x7fe8d00b44c0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.789+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d00c87e0 con 0x7fe8d00b44c0 2024-05-10T03:53:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.790+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d006a7e0 con 0x7fe8d00b44c0 2024-05-10T03:53:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.791+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe8c003a070 con 0x7fe8d00b44c0 2024-05-10T03:53:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.791+0000 7fe8ccff9640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe8bc0762d0 0x7fe8bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.791+0000 7fe8cf7fe640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe8bc0762d0 0x7fe8bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.791+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe8c00b77c0 con 0x7fe8d00b44c0 2024-05-10T03:53:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.792+0000 7fe8cf7fe640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe8bc0762d0 0x7fe8bc078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009560 tx=0x7fe8c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:54.795+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe8c0080ad0 con 0x7fe8d00b44c0 2024-05-10T03:53:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.025+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe8d00d0b80 con 0x7fe8d00b44c0 2024-05-10T03:53:55.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.026+0000 7fe8ccff9640 1 -- 172.21.15.55:0/2419783463 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fe8c0084dd0 con 0x7fe8d00b44c0 2024-05-10T03:53:55.028 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T03:53:55.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe8bc0762d0 msgr2=0x7fe8bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:55.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe8bc0762d0 0x7fe8bc078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009560 tx=0x7fe8c4009190 comp rx=0 tx=0).stop 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 msgr2=0x7fe8d00c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 0x7fe8d00c7b90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0035040 tx=0x7fe8c00046c0 comp rx=0 tx=0).stop 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 shutdown_connections 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d00ce590 0x7fe8d00ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d00b5660 0x7fe8d00a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe8bc0762d0 0x7fe8bc078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 --2- 172.21.15.55:0/2419783463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8d00b44c0 0x7fe8d00c7b90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.027+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 >> 172.21.15.55:0/2419783463 conn(0x7fe8d00b4b40 msgr2=0x7fe8d00b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.028+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 shutdown_connections 2024-05-10T03:53:55.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55.028+0000 7fe8d6324640 1 -- 172.21.15.55:0/2419783463 wait complete. 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T03:53:55.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T03:53:55.042 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:53:55.042 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:53:55.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:55.042 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-05-10T03:53:55.059 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:53:55.059 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:53:55.059 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:53:55.059 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:55.059 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-10T03:53:55.060 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:55.060 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:55.060 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:55.060 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-05-10T03:53:55.060 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:55.060 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:55.061 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-05-10T03:53:55.061 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:53:55.061 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:55.061 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-05-10T03:53:55.061 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T03:53:55.061 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-05-10T03:53:55.062 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-05-10T03:53:55.062 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:55.062 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:55.062 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:55.062 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-05-10T03:53:55.063 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T03:53:55.063 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:55.063 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:55.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-05-10T03:53:55.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-05-10T03:53:55.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-05-10T03:53:55.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T03:53:55.064 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:55.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:55.243 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:53:55.269 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-05-10T03:53:55.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:55.271 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-05-10T03:53:55.340 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-05-10T03:53:55.340 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:53:55.341 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T03:53:55.341 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T03:53:55.341 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:53:55.341 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:55.341 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:55.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T03:53:55.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T03:53:55.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T03:53:55.341 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:55.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:55.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:55.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:55.636 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:53:55.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:55.653 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-05-10T03:53:55.709 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:55.709 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:55.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T03:53:55.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T03:53:55.709 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:55.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:55.833 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T03:53:55.833 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T03:53:55.834 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:55.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:55.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:55.969 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:55.969 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:55.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-05-10T03:53:55.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T03:53:55.969 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:56.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:56.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:53:56.051 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T03:53:56.067 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:53:56.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:53:56.067 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T03:53:56.123 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T03:53:56.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:56.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:53:56.212 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:53:56.212 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T03:53:56.212 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:53:56.320 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:53:56.320 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T03:53:56.320 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:53:56.320 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:53:56.320 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:53:56.325 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:53:56.325 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T03:53:56.326 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:53:56.326 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:53:56.326 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:53:56.326 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790" 2024-05-10T03:53:56.326 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2024-05-10T03:53:56.326 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=799093e3-fb07-47b3-97e4-8d13003c3bca" will pass to kernel 2024-05-10T03:53:56.327 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T03:53:56.327 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-05-10T03:53:56.327 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T03:53:56.327 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T03:53:56.328 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T03:53:56.329 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T03:53:56.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:56.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T03:53:56.356 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:53:56.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:53:56.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:56.460 INFO:teuthology.orchestra.run.smithi055.stdout:client4516 2024-05-10T03:53:56.460 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:56.460 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:53:56.476 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:53:56.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:53:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:56.580 INFO:teuthology.orchestra.run.smithi055.stdout:client4516 2024-05-10T03:53:56.580 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:53:56.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:53:56.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:56.643 INFO:teuthology.orchestra.run.smithi055.stdout:client4516 2024-05-10T03:53:56.644 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/799093e3-fb07-47b3-97e4-8d13003c3bca.client4516/status') 2024-05-10T03:53:56.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:56.718 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4516 (3)172.21.15.55:0/442416480 2024-05-10T03:53:56.718 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-05-10T03:53:56.719 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-05-10T03:53:56.719 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-05-10T03:53:56.719 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.3604e-05 s, 2.9 MB/s 2024-05-10T03:53:56.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:56.726 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-10T03:53:56.727 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T03:53:56.727 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T03:53:56.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T03:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.828+0000 7f975f86d640 1 Processor -- start 2024-05-10T03:53:56.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.828+0000 7f975f86d640 1 -- start start 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975f86d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9758157760 0x7f97580b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975f86d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f9758073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975f86d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9758073f70 0x7f97580ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975f86d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f97580b3660 con 0x7f9758073f70 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975f86d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f9758161940 con 0x7f9758157760 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975f86d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9758157b40 con 0x7f97580b3200 2024-05-10T03:53:56.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9758073f70 0x7f97580ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9758073f70 0x7f97580ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54942/0 (socket says 172.21.15.55:54942) 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 -- 172.21.15.55:0/1932735013 learned_addr learned my addr 172.21.15.55:0/1932735013 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975d609640 1 --2- 172.21.15.55:0/1932735013 >> v2:172.21.15.64:3300/0 conn(0x7f9758157760 0x7f97580b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975ce08640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f9758073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 -- 172.21.15.55:0/1932735013 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 msgr2=0x7f9758073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f9758073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 -- 172.21.15.55:0/1932735013 >> v2:172.21.15.64:3300/0 conn(0x7f9758157760 msgr2=0x7f97580b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 --2- 172.21.15.55:0/1932735013 >> v2:172.21.15.64:3300/0 conn(0x7f9758157760 0x7f97580b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975de0a640 1 -- 172.21.15.55:0/1932735013 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9758160d30 con 0x7f9758073f70 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975ce08640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f9758073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:56.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.829+0000 7f975d609640 1 --2- 172.21.15.55:0/1932735013 >> v2:172.21.15.64:3300/0 conn(0x7f9758157760 0x7f97580b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.830+0000 7f975de0a640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758073f70 0x7f97580ce620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97580b6400 tx=0x7f975002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d66b44dedfb862 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.830+0000 7f974ffff640 1 -- 172.21.15.55:0/1932735013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750036070 con 0x7f9758073f70 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.830+0000 7f974ffff640 1 -- 172.21.15.55:0/1932735013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750031600 con 0x7f9758073f70 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.830+0000 7f974ffff640 1 -- 172.21.15.55:0/1932735013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500319d0 con 0x7f9758073f70 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 -- 172.21.15.55:0/1932735013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758073f70 msgr2=0x7f97580ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758073f70 0x7f97580ce620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f97580b6400 tx=0x7f975002a610 comp rx=0 tx=0).stop 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 -- 172.21.15.55:0/1932735013 shutdown_connections 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758073f70 0x7f97580ce620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 --2- 172.21.15.55:0/1932735013 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f9758073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 --2- 172.21.15.55:0/1932735013 >> v2:172.21.15.64:3300/0 conn(0x7f9758157760 0x7f97580b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 -- 172.21.15.55:0/1932735013 >> 172.21.15.55:0/1932735013 conn(0x7f975806fac0 msgr2=0x7f975806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 -- 172.21.15.55:0/1932735013 shutdown_connections 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.831+0000 7f975f86d640 1 -- 172.21.15.55:0/1932735013 wait complete. 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.832+0000 7f975f86d640 1 Processor -- start 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.832+0000 7f975f86d640 1 -- start start 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975f86d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9758073f70 0x7f975814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975f86d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f97580b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975f86d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 0x7f97580b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975f86d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f97581615d0 con 0x7f9758157760 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975f86d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f97581612f0 con 0x7f9758073f70 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975f86d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f975815e860 con 0x7f97580b3200 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 0x7f97580b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 0x7f97580b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54946/0 (socket says 172.21.15.55:54946) 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 -- 172.21.15.55:0/4136589265 learned_addr learned my addr 172.21.15.55:0/4136589265 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975ce08640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f97580b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975d609640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9758073f70 0x7f975814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 -- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 msgr2=0x7f97580b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f97580b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 -- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9758073f70 msgr2=0x7f975814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9758073f70 0x7f975814ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 -- 172.21.15.55:0/4136589265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975814f6e0 con 0x7f9758157760 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.833+0000 7f975de0a640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 0x7f97580b2230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9750009f40 tx=0x7f9750004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.834+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750036050 con 0x7f9758157760 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.834+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750042070 con 0x7f9758157760 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.834+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975814f9c0 con 0x7f9758157760 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.834+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750009510 con 0x7f9758157760 2024-05-10T03:53:56.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.834+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975814ff80 con 0x7f9758157760 2024-05-10T03:53:56.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.835+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975806a7e0 con 0x7f9758157760 2024-05-10T03:53:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.836+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9750007bd0 con 0x7f9758157760 2024-05-10T03:53:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.836+0000 7f974dffb640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f973c0762d0 0x7f973c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.836+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f97500b8670 con 0x7f9758157760 2024-05-10T03:53:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.836+0000 7f975d609640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f973c0762d0 0x7f973c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.836+0000 7f975d609640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f973c0762d0 0x7f973c078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f975400a910 tx=0x7f9754008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:56.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:56.840+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9750081f40 con 0x7f9758157760 2024-05-10T03:53:57.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.071+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9758154b10 con 0x7f9758157760 2024-05-10T03:53:57.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.071+0000 7f974dffb640 1 -- 172.21.15.55:0/4136589265 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f9750081840 con 0x7f9758157760 2024-05-10T03:53:57.074 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T03:53:57.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f973c0762d0 msgr2=0x7f973c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:57.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f973c0762d0 0x7f973c078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f975400a910 tx=0x7f9754008040 comp rx=0 tx=0).stop 2024-05-10T03:53:57.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 msgr2=0x7f97580b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:57.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 0x7f97580b2230 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9750009f40 tx=0x7f9750004a40 comp rx=0 tx=0).stop 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 shutdown_connections 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f973c0762d0 0x7f973c078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9758157760 0x7f97580b2230 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97580b3200 0x7f97580b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 --2- 172.21.15.55:0/4136589265 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9758073f70 0x7f975814ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 >> 172.21.15.55:0/4136589265 conn(0x7f975806fac0 msgr2=0x7f9758156090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 shutdown_connections 2024-05-10T03:53:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57.073+0000 7f975f86d640 1 -- 172.21.15.55:0/4136589265 wait complete. 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:53:57.087 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-10T03:53:57.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.088 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:57.104 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42694sec preferred_lft 42694sec 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 86:b8:f9:2b:b4:cd brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T03:53:57.105 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::eca8:a3ff:fea7:50a3/64 scope link 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 86:b8:f9:2b:b4:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::84b8:f9ff:fe2b:b4cd/64 scope link tentative 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.106 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:53:57.169 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-05-10T03:53:57.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.170 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-05-10T03:53:57.228 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-05-10T03:53:57.228 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:53:57.228 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T03:53:57.228 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T03:53:57.228 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:53:57.228 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:57.228 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:57.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T03:53:57.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T03:53:57.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T03:53:57.229 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:57.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:57.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.359 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:53:57.374 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T03:53:57.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.375 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-05-10T03:53:57.430 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-10T03:53:57.430 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:57.431 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:57.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T03:53:57.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-10T03:53:57.431 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:57.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:57.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0a:16:46:cc:1b:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::816:46ff:fecc:1b3f/64 scope link 2024-05-10T03:53:57.577 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:53:57.655 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0a:16:46:cc:1b:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T03:53:57.656 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T03:53:57.656 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.656 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::816:46ff:fecc:1b3f/64 scope link 2024-05-10T03:53:57.656 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:57.657 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-10T03:53:57.657 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:57.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:57.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:57.814 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:57.814 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:53:57.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2024-05-10T03:53:57.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T03:53:57.814 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:53:57.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:57.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:53:57.893 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-10T03:53:57.909 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-10T03:53:57.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:53:57.909 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-10T03:53:57.965 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T03:53:57.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:57.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T03:53:58.050 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T03:53:58.050 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T03:53:58.050 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:53:58.059 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T03:53:58.092 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T03:53:58.092 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:53:58.092 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:53:58.092 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790" 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=799093e3-fb07-47b3-97e4-8d13003c3bca" will pass to kernel 2024-05-10T03:53:58.093 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-10T03:53:58.094 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-05-10T03:53:58.094 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T03:53:58.094 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T03:53:58.094 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T03:53:58.094 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T03:53:58.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:58.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-10T03:53:58.120 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:53:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:53:58.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:58.219 INFO:teuthology.orchestra.run.smithi055.stdout:client4463 2024-05-10T03:53:58.219 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:53:58.219 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:53:58.235 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:53:58.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:53:58.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:58.334 INFO:teuthology.orchestra.run.smithi055.stdout:client4463 2024-05-10T03:53:58.334 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:53:58.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:53:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:58.392 INFO:teuthology.orchestra.run.smithi055.stdout:client4463 2024-05-10T03:53:58.392 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/799093e3-fb07-47b3-97e4-8d13003c3bca.client4463/status') 2024-05-10T03:53:58.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:58.453 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4463 (3)172.21.15.55:0/461027709 2024-05-10T03:53:58.453 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-05-10T03:53:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-05-10T03:53:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-05-10T03:53:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.342e-05 s, 2.9 MB/s 2024-05-10T03:53:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:58.460 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-10T03:53:58.460 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T03:53:58.461 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T03:53:58.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T03:53:58.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.562+0000 7f1bbd9af640 1 Processor -- start 2024-05-10T03:53:58.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.562+0000 7f1bbd9af640 1 -- start start 2024-05-10T03:53:58.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bbd9af640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:58.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bbd9af640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1bb815f830 0x7f1bb80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:58.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bbd9af640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb80b5da0 con 0x7f1bb80d03b0 2024-05-10T03:53:58.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bbd9af640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb8163460 con 0x7f1bb815f830 2024-05-10T03:53:58.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bbd9af640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80b6080 con 0x7f1bb815f450 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bb67fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1bb815f830 0x7f1bb80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bb6ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bb67fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1bb815f830 0x7f1bb80b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:58664/0 (socket says 172.21.15.55:58664) 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.563+0000 7f1bb67fc640 1 -- 172.21.15.55:0/2235886261 learned_addr learned my addr 172.21.15.55:0/2235886261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb67fc640 1 -- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 msgr2=0x7f1bb80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb67fc640 1 --2- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb67fc640 1 -- 172.21.15.55:0/2235886261 >> v1:172.21.15.64:6789/0 conn(0x7f1bb80d03b0 legacy=0x7f1bb80d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb5ffb640 1 -- 172.21.15.55:0/2235886261 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048474574 0 0) 0x7f1bb80b5da0 con 0x7f1bb80d03b0 2024-05-10T03:53:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb67fc640 1 -- 172.21.15.55:0/2235886261 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb80d3020 con 0x7f1bb815f830 2024-05-10T03:53:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb67fc640 1 --2- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80b5200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009870 tx=0x7f1ba002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74faf7823d6e017 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.564+0000 7f1bb5ffb640 1 -- 172.21.15.55:0/2235886261 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0037070 con 0x7f1bb815f830 2024-05-10T03:53:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bb5ffb640 1 -- 172.21.15.55:0/2235886261 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba0032440 con 0x7f1bb815f830 2024-05-10T03:53:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bb5ffb640 1 -- 172.21.15.55:0/2235886261 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0032810 con 0x7f1bb815f830 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 msgr2=0x7f1bb80b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80b5200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009870 tx=0x7f1ba002a270 comp rx=0 tx=0).stop 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2235886261 shutdown_connections 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80b5200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2235886261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2235886261 >> 172.21.15.55:0/2235886261 conn(0x7f1bb808ec90 msgr2=0x7f1bb809e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2235886261 shutdown_connections 2024-05-10T03:53:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.565+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2235886261 wait complete. 2024-05-10T03:53:58.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.566+0000 7f1bbd9af640 1 Processor -- start 2024-05-10T03:53:58.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 -- start start 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 0x7f1bb81f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80d5af0 con 0x7f1bb80d03b0 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80d5970 con 0x7f1bb815f830 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bbd9af640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80b5740 con 0x7f1bb815f450 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.567+0000 7f1bb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 0x7f1bb81f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 0x7f1bb81f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54960/0 (socket says 172.21.15.55:54960) 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 -- 172.21.15.55:0/2888614413 learned_addr learned my addr 172.21.15.55:0/2888614413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb67fc640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb77fe640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 -- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 msgr2=0x7f1bb80b9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80b9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 -- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 msgr2=0x7f1bb80cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 -- 172.21.15.55:0/2888614413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb80ba720 con 0x7f1bb80d03b0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb77fe640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb67fc640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bb6ffd640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 0x7f1bb81f6960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000e9e0 tx=0x7f1bb000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0017070 con 0x7f1bb80d03b0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb000c9d0 con 0x7f1bb80d03b0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000cdc0 con 0x7f1bb80d03b0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb80baa00 con 0x7f1bb80d03b0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.568+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb80b8270 con 0x7f1bb80d03b0 2024-05-10T03:53:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.569+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb80d5790 con 0x7f1bb80d03b0 2024-05-10T03:53:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.570+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1bb001a070 con 0x7f1bb80d03b0 2024-05-10T03:53:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.570+0000 7f1baffff640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1b980762d0 0x7f1b98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:53:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.570+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb0097920 con 0x7f1bb80d03b0 2024-05-10T03:53:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.570+0000 7f1bb67fc640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1b980762d0 0x7f1b98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:53:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.571+0000 7f1bb67fc640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1b980762d0 0x7f1b98078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0034000 tx=0x7f1ba002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:53:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.575+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1bb80d5790 con 0x7f1bb80d03b0 2024-05-10T03:53:58.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.806+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1bb806a7e0 con 0x7f1bb80d03b0 2024-05-10T03:53:58.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.807+0000 7f1baffff640 1 -- 172.21.15.55:0/2888614413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f1bb0061310 con 0x7f1bb80d03b0 2024-05-10T03:53:58.809 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1b980762d0 msgr2=0x7f1b98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1b980762d0 0x7f1b98078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0034000 tx=0x7f1ba002e000 comp rx=0 tx=0).stop 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 msgr2=0x7f1bb81f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 0x7f1bb81f6960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000e9e0 tx=0x7f1bb000eea0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 shutdown_connections 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bb815f830 0x7f1bb80cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bb815f450 0x7f1bb80b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1b980762d0 0x7f1b98078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 --2- 172.21.15.55:0/2888614413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bb80d03b0 0x7f1bb81f6960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 >> 172.21.15.55:0/2888614413 conn(0x7f1bb808ec90 msgr2=0x7f1bb806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 shutdown_connections 2024-05-10T03:53:58.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:53:58.809+0000 7f1bbd9af640 1 -- 172.21.15.55:0/2888614413 wait complete. 2024-05-10T03:53:58.822 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:53:58.823 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-10T03:53:58.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:58.823 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-05-10T03:53:58.843 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:53:58.843 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:53:58.843 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:53:58.843 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:58.843 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-05-10T03:53:58.843 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-05-10T03:53:58.844 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:53:58.845 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T03:53:58.845 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:53:58.942 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:59.038 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:59.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:59.044 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:53:59.070 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-05-10T03:53:59.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:59.072 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-05-10T03:53:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-05-10T03:53:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:53:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T03:53:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T03:53:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:53:59.136 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:59.136 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:53:59.137 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T03:53:59.137 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T03:53:59.137 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T03:53:59.137 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:53:59.226 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:59.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:59.452 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-05-10T03:53:59.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:59.469 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2024-05-10T03:53:59.526 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:59.526 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:53:59.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T03:53:59.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-10T03:53:59.526 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:53:59.617 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:59.643 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:59.649 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-10T03:53:59.649 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-10T03:53:59.650 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:53:59.701 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:59.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:59.788 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:53:59.788 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:53:59.788 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2024-05-10T03:53:59.788 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T03:53:59.788 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:53:59.839 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:53:59.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:53:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:53:59.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:53:59.868 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-10T03:53:59.884 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-10T03:53:59.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:53:59.884 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-10T03:53:59.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T03:53:59.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:53:59.941 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T03:54:00.030 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T03:54:00.030 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T03:54:00.030 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-05-10T03:54:00.140 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T03:54:00.140 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T03:54:00.140 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-05-10T03:54:00.140 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:54:00.140 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:54:00.145 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T03:54:00.145 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T03:54:00.145 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-05-10T03:54:00.146 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:54:00.146 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:54:00.146 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790" 2024-05-10T03:54:00.146 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2024-05-10T03:54:00.146 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=799093e3-fb07-47b3-97e4-8d13003c3bca" will pass to kernel 2024-05-10T03:54:00.146 INFO:teuthology.orchestra.run.smithi064.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-10T03:54:00.147 INFO:teuthology.orchestra.run.smithi064.stdout: You just mounted a file system that supports labels which does not 2024-05-10T03:54:00.147 INFO:teuthology.orchestra.run.smithi064.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T03:54:00.147 INFO:teuthology.orchestra.run.smithi064.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T03:54:00.147 INFO:teuthology.orchestra.run.smithi064.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T03:54:00.148 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T03:54:00.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:00.149 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-10T03:54:00.175 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:00.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:00.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:00.274 INFO:teuthology.orchestra.run.smithi064.stdout:client4632 2024-05-10T03:54:00.275 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:00.275 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:00.291 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:00.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:00.385 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:00.391 INFO:teuthology.orchestra.run.smithi064.stdout:client4632 2024-05-10T03:54:00.391 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:00.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:00.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:00.449 INFO:teuthology.orchestra.run.smithi064.stdout:client4632 2024-05-10T03:54:00.450 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/799093e3-fb07-47b3-97e4-8d13003c3bca.client4632/status') 2024-05-10T03:54:00.500 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:00.511 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.4632 (3)172.21.15.64:0/1742262570 2024-05-10T03:54:00.511 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2024-05-10T03:54:00.511 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2024-05-10T03:54:00.511 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2024-05-10T03:54:00.512 INFO:teuthology.orchestra.run.smithi064.stderr:70 bytes copied, 2.2902e-05 s, 3.1 MB/s 2024-05-10T03:54:00.512 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:00.519 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-10T03:54:00.519 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T03:54:00.519 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T03:54:00.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T03:54:00.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.633+0000 7f6ad2015640 1 Processor -- start 2024-05-10T03:54:00.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.633+0000 7f6ad2015640 1 -- start start 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6ad2015640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6acc0b5660 0x7f6acc0d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6ad2015640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc0cd7d0 con 0x7f6acc0b44c0 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6ad2015640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc0cdab0 con 0x7f6acc09c170 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6ad2015640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f6acc0b48a0 con 0x7f6acc0b5660 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6acb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6acc0b44c0 0x7f6acc09ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45866/0 (socket says 172.21.15.55:45866) 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6acb7fe640 1 -- 172.21.15.55:0/3258790435 learned_addr learned my addr 172.21.15.55:0/3258790435 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6acbfff640 1 --2- 172.21.15.55:0/3258790435 >> v2:172.21.15.64:3300/0 conn(0x7f6acc0b5660 0x7f6acc0d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991753976 0 0) 0x7f6acc0cd7d0 con 0x7f6acc0b44c0 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab4003520 con 0x7f6acc0b44c0 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.634+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889653816 0 0) 0x7f6acc0cdab0 con 0x7f6acc09c170 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6acc0cd7d0 con 0x7f6acc09c170 2024-05-10T03:54:00.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3134349740 0 0) 0x7f6ab4003520 con 0x7f6acc0b44c0 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 >> v2:172.21.15.64:3300/0 conn(0x7f6acc0b5660 msgr2=0x7f6acc0d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 --2- 172.21.15.55:0/3258790435 >> v2:172.21.15.64:3300/0 conn(0x7f6acc0b5660 0x7f6acc0d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 >> v1:172.21.15.64:6789/0 conn(0x7f6acc09c170 legacy=0x7f6acc0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc0cdd90 con 0x7f6acc0b44c0 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acbfff640 1 --2- 172.21.15.55:0/3258790435 >> v2:172.21.15.64:3300/0 conn(0x7f6acc0b5660 0x7f6acc0d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f6abc0016f0 con 0x7f6acc0b44c0 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 >> v1:172.21.15.55:6789/0 conn(0x7f6acc0b44c0 legacy=0x7f6acc09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4003c30 0x7f6ab4004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ab4004800 0x7f6ab4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ab40052d0 0x7f6ab400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc0b48a0 con 0x7f6ab4004800 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab400c1e0 con 0x7f6ab4003c30 2024-05-10T03:54:00.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab400c3e0 con 0x7f6ab40052d0 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acaffd640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ab4004800 0x7f6ab4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acb7fe640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4003c30 0x7f6ab4004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acbfff640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ab40052d0 0x7f6ab400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acaffd640 1 -- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ab40052d0 msgr2=0x7f6ab400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acaffd640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ab40052d0 0x7f6ab400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acaffd640 1 -- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4003c30 msgr2=0x7f6ab4004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acaffd640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4003c30 0x7f6ab4004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acbfff640 1 -- 172.21.15.55:0/3258790435 reap_dead start 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acaffd640 1 -- 172.21.15.55:0/3258790435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab4003520 con 0x7f6ab4004800 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.635+0000 7f6acb7fe640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4003c30 0x7f6ab4004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.636+0000 7f6acaffd640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ab4004800 0x7f6ab4004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0001900 tx=0x7f6ab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447839f8506bf684 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.636+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0001520 con 0x7f6ab4004800 2024-05-10T03:54:00.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.636+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac00052f0 con 0x7f6ab4004800 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.636+0000 7f6aca7fc640 1 -- 172.21.15.55:0/3258790435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac002ac80 con 0x7f6ab4004800 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 -- 172.21.15.55:0/3258790435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ab4004800 msgr2=0x7f6ab4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ab4004800 0x7f6ab4004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0001900 tx=0x7f6ab4005830 comp rx=0 tx=0).stop 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 -- 172.21.15.55:0/3258790435 shutdown_connections 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3258790435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ab4004800 0x7f6ab4004c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 -- 172.21.15.55:0/3258790435 >> 172.21.15.55:0/3258790435 conn(0x7f6acc0b4b40 msgr2=0x7f6acc0b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 -- 172.21.15.55:0/3258790435 shutdown_connections 2024-05-10T03:54:00.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.637+0000 7f6ad2015640 1 -- 172.21.15.55:0/3258790435 wait complete. 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.638+0000 7f6ad2015640 1 Processor -- start 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.638+0000 7f6ad2015640 1 -- start start 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6ad2015640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4004800 0x7f6acc0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6ad2015640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6acc0b5ad0 0x7f6acc0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6ad2015640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 0x7f6acc155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6ad2015640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc06e310 con 0x7f6acc155100 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6ad2015640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc06e6b0 con 0x7f6ab4004800 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6ad2015640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6acc06e490 con 0x7f6acc0b5ad0 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 0x7f6acc155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 0x7f6acc155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54978/0 (socket says 172.21.15.55:54978) 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 -- 172.21.15.55:0/3300690147 learned_addr learned my addr 172.21.15.55:0/3300690147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:00.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acaffd640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6acc0b5ad0 0x7f6acc0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acb7fe640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4004800 0x7f6acc0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 -- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6acc0b5ad0 msgr2=0x7f6acc0b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6acc0b5ad0 0x7f6acc0b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 -- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4004800 msgr2=0x7f6acc0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4004800 0x7f6acc0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acbfff640 1 -- 172.21.15.55:0/3300690147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc1f8a30 con 0x7f6acc155100 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.639+0000 7f6acaffd640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6acc0b5ad0 0x7f6acc0b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.640+0000 7f6acbfff640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 0x7f6acc155560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6acc074740 tx=0x7f6ac400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.640+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4003990 con 0x7f6acc155100 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.640+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac4003b30 con 0x7f6acc155100 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.640+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4004020 con 0x7f6acc155100 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.640+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc1f8d10 con 0x7f6acc155100 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.640+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6acc1f92d0 con 0x7f6acc155100 2024-05-10T03:54:00.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.641+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc06a7e0 con 0x7f6acc155100 2024-05-10T03:54:00.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.641+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ac40041c0 con 0x7f6acc155100 2024-05-10T03:54:00.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.642+0000 7f6ab3fff640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ab80762d0 0x7f6ab8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:00.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.642+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6ac40981d0 con 0x7f6acc155100 2024-05-10T03:54:00.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.642+0000 7f6acb7fe640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ab80762d0 0x7f6ab8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:00.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.642+0000 7f6acb7fe640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ab80762d0 0x7f6ab8078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6abc007c70 tx=0x7f6abc000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:00.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.646+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ac4019030 con 0x7f6acc155100 2024-05-10T03:54:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.880+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6acc0d2dc0 con 0x7f6acc155100 2024-05-10T03:54:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.880+0000 7f6ab3fff640 1 -- 172.21.15.55:0/3300690147 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6ac4010040 con 0x7f6acc155100 2024-05-10T03:54:00.883 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ab80762d0 msgr2=0x7f6ab8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ab80762d0 0x7f6ab8078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6abc007c70 tx=0x7f6abc000ed0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 msgr2=0x7f6acc155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 0x7f6acc155560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6acc074740 tx=0x7f6ac400f580 comp rx=0 tx=0).stop 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 shutdown_connections 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f6ab80762d0 0x7f6ab8078790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6acc155100 0x7f6acc155560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6acc0b5ad0 0x7f6acc0b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 --2- 172.21.15.55:0/3300690147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab4004800 0x7f6acc0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 >> 172.21.15.55:0/3300690147 conn(0x7f6acc0b4b40 msgr2=0x7f6acc09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 shutdown_connections 2024-05-10T03:54:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:00.882+0000 7f6ad2015640 1 -- 172.21.15.55:0/3300690147 wait complete. 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:54:00.896 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-10T03:54:00.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:00.897 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2024-05-10T03:54:00.914 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:54:00.914 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:54:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42737sec preferred_lft 42737sec 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 82:fa:5b:0d:43:4f brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::1047:cff:feab:ec7e/64 scope link 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 82:fa:5b:0d:43:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::80fa:5bff:fe0d:434f/64 scope link tentative 2024-05-10T03:54:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:00.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:00.917 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:54:00.982 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-05-10T03:54:00.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:00.984 DEBUG:teuthology.orchestra.run.smithi064:> route 2024-05-10T03:54:01.041 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2024-05-10T03:54:01.041 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:54:01.041 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T03:54:01.041 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T03:54:01.041 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:54:01.042 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:54:01.042 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:54:01.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T03:54:01.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T03:54:01.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T03:54:01.042 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:54:01.133 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:01.167 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:01.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:01.174 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-05-10T03:54:01.190 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T03:54:01.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:01.190 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2024-05-10T03:54:01.246 INFO:teuthology.orchestra.run.smithi064.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-10T03:54:01.246 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:54:01.246 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:54:01.246 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T03:54:01.246 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-10T03:54:01.247 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:54:01.337 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:01.360 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:01.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:01.367 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T03:54:01.393 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:54:01.393 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:54:01.393 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:54:01.393 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.393 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-05-10T03:54:01.393 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.394 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:54:01.394 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 92:30:e8:91:5d:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T03:54:01.394 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T03:54:01.394 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.394 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::9030:e8ff:fe91:5d39/64 scope link tentative 2024-05-10T03:54:01.394 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:01.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 92:30:e8:91:5d:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T03:54:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.462 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::9030:e8ff:fe91:5d39/64 scope link tentative 2024-05-10T03:54:01.462 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:01.463 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-10T03:54:01.463 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:54:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:01.612 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:01.619 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:54:01.619 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2024-05-10T03:54:01.619 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.1 up 2024-05-10T03:54:01.619 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T03:54:01.619 DEBUG:teuthology.orchestra.run.smithi064:> ') 2024-05-10T03:54:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:01.692 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:01.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:54:01.699 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-10T03:54:01.717 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-10T03:54:01.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:54:01.717 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-10T03:54:01.772 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T03:54:01.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:01.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T03:54:01.858 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T03:54:01.859 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T03:54:01.859 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-05-10T03:54:01.867 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T03:54:01.867 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T03:54:01.867 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-05-10T03:54:01.867 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:54:01.867 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:54:01.872 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T03:54:01.872 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T03:54:01.872 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2024-05-10T03:54:01.872 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790" 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=799093e3-fb07-47b3-97e4-8d13003c3bca" will pass to kernel 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout: You just mounted a file system that supports labels which does not 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T03:54:01.873 INFO:teuthology.orchestra.run.smithi064.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T03:54:01.875 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T03:54:01.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:01.875 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-10T03:54:01.901 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:01.991 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:01.993 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:01.999 INFO:teuthology.orchestra.run.smithi064.stdout:client4472 2024-05-10T03:54:01.999 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:01.999 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:02.015 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:02.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:02.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:02.113 INFO:teuthology.orchestra.run.smithi064.stdout:client4472 2024-05-10T03:54:02.113 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:02.163 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:02.165 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:02.170 INFO:teuthology.orchestra.run.smithi064.stdout:client4472 2024-05-10T03:54:02.171 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/799093e3-fb07-47b3-97e4-8d13003c3bca.client4472/status') 2024-05-10T03:54:02.221 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:02.231 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.4472 (3)192.168.0.2:0/1607600723 2024-05-10T03:54:02.231 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2024-05-10T03:54:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2024-05-10T03:54:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2024-05-10T03:54:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:69 bytes copied, 2.5109e-05 s, 2.7 MB/s 2024-05-10T03:54:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:2024-05-10T03:54:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:02.238 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-10T03:54:02.320 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-10T03:54:02.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.433+0000 7ff088fb6640 1 Processor -- start 2024-05-10T03:54:02.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.433+0000 7ff088fb6640 1 -- start start 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff088fb6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff08415d290 0x7ff084074210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff088fb6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff084073ba0 0x7ff0840b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff088fb6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0840b6810 0x7ff0840722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff088fb6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7ff08415d670 con 0x7ff0840b6810 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff088fb6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff0840b3980 con 0x7ff084073ba0 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff088fb6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff0840cdb20 con 0x7ff08415d290 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff082d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0840b6810 0x7ff0840722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff082d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff0840b6810 0x7ff0840722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54980/0 (socket says 172.21.15.55:54980) 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.434+0000 7ff082d9d640 1 -- 172.21.15.55:0/1474003719 learned_addr learned my addr 172.21.15.55:0/1474003719 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff08259c640 1 --2- 172.21.15.55:0/1474003719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff08415d290 0x7ff084074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff081d9b640 1 --2- 172.21.15.55:0/1474003719 >> v2:172.21.15.64:3300/0 conn(0x7ff084073ba0 0x7ff0840b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff082d9d640 1 -- 172.21.15.55:0/1474003719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff08415d290 msgr2=0x7ff084074210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff082d9d640 1 --2- 172.21.15.55:0/1474003719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff08415d290 0x7ff084074210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff082d9d640 1 -- 172.21.15.55:0/1474003719 >> v2:172.21.15.64:3300/0 conn(0x7ff084073ba0 msgr2=0x7ff0840b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff082d9d640 1 --2- 172.21.15.55:0/1474003719 >> v2:172.21.15.64:3300/0 conn(0x7ff084073ba0 0x7ff0840b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff082d9d640 1 -- 172.21.15.55:0/1474003719 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0840cde00 con 0x7ff0840b6810 2024-05-10T03:54:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff081d9b640 1 --2- 172.21.15.55:0/1474003719 >> v2:172.21.15.64:3300/0 conn(0x7ff084073ba0 0x7ff0840b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.435+0000 7ff082d9d640 1 --2- 172.21.15.55:0/1474003719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0840722c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff08406dee0 tx=0x7ff07402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7c3de2ad9840c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:02.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff08159a640 1 -- 172.21.15.55:0/1474003719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074036070 con 0x7ff0840b6810 2024-05-10T03:54:02.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff08159a640 1 -- 172.21.15.55:0/1474003719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff074031600 con 0x7ff0840b6810 2024-05-10T03:54:02.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff08159a640 1 -- 172.21.15.55:0/1474003719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0740319d0 con 0x7ff0840b6810 2024-05-10T03:54:02.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 -- 172.21.15.55:0/1474003719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 msgr2=0x7ff0840722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1474003719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0840722c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff08406dee0 tx=0x7ff07402a610 comp rx=0 tx=0).stop 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 -- 172.21.15.55:0/1474003719 shutdown_connections 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1474003719 >> v2:172.21.15.64:3300/0 conn(0x7ff084073ba0 0x7ff0840b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1474003719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0840722c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1474003719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff08415d290 0x7ff084074210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 -- 172.21.15.55:0/1474003719 >> 172.21.15.55:0/1474003719 conn(0x7ff0840b2cc0 msgr2=0x7ff0840b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 -- 172.21.15.55:0/1474003719 shutdown_connections 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.436+0000 7ff088fb6640 1 -- 172.21.15.55:0/1474003719 wait complete. 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 Processor -- start 2024-05-10T03:54:02.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 -- start start 2024-05-10T03:54:02.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff084073ba0 0x7ff0841499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0841460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff08415d290 0x7ff084146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff084072980 con 0x7ff0840b6810 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff084072800 con 0x7ff08415d290 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.438+0000 7ff088fb6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff084072b00 con 0x7ff084073ba0 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0841460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0841460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54986/0 (socket says 172.21.15.55:54986) 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 -- 172.21.15.55:0/1821392649 learned_addr learned my addr 172.21.15.55:0/1821392649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff08259c640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff084073ba0 0x7ff0841499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff082d9d640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff08415d290 0x7ff084146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 -- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff084073ba0 msgr2=0x7ff0841499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff084073ba0 0x7ff0841499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 -- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff08415d290 msgr2=0x7ff084146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff08415d290 0x7ff084146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 -- 172.21.15.55:0/1821392649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08414a390 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff08259c640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff084073ba0 0x7ff0841499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff081d9b640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0841460d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c7f0 tx=0x7ff06c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c015070 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06c007a30 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0840af480 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c007e00 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.439+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0840afa40 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.440+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08406f450 con 0x7ff0840b6810 2024-05-10T03:54:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.441+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff06c018070 con 0x7ff0840b6810 2024-05-10T03:54:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.442+0000 7ff07affd640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff064076300 0x7ff0640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.442+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff06c0974d0 con 0x7ff0840b6810 2024-05-10T03:54:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.442+0000 7ff08259c640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff064076300 0x7ff0640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.442+0000 7ff08259c640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff064076300 0x7ff0640787c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff07c006fd0 tx=0x7ff07c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:02.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.446+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff06c060e30 con 0x7ff0840b6810 2024-05-10T03:54:02.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.640+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff084160ad0 con 0x7ff0840b6810 2024-05-10T03:54:02.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.641+0000 7ff07affd640 1 -- 172.21.15.55:0/1821392649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7ff06c060730 con 0x7ff0840b6810 2024-05-10T03:54:02.644 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:02.644 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff064076300 msgr2=0x7ff0640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff064076300 0x7ff0640787c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff07c006fd0 tx=0x7ff07c008040 comp rx=0 tx=0).stop 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 msgr2=0x7ff0841460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0841460d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c7f0 tx=0x7ff06c00ccb0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 shutdown_connections 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff08415d290 0x7ff084146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff064076300 0x7ff0640787c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0840b6810 0x7ff0841460d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 --2- 172.21.15.55:0/1821392649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff084073ba0 0x7ff0841499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 >> 172.21.15.55:0/1821392649 conn(0x7ff0840b2cc0 msgr2=0x7ff08415edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:02.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 shutdown_connections 2024-05-10T03:54:02.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.643+0000 7ff088fb6640 1 -- 172.21.15.55:0/1821392649 wait complete. 2024-05-10T03:54:02.657 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T03:53:33.798554+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T03:53:35.315747+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T03:53:36.586927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T03:54:02.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T03:54:02.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.761+0000 7f4d307da640 1 Processor -- start 2024-05-10T03:54:02.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.761+0000 7f4d307da640 1 -- start start 2024-05-10T03:54:02.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d307da640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d2815f2b0 0x7f4d280d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d307da640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d2815f690 0x7f4d280d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d307da640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d280d3e80 con 0x7f4d280d4f20 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d307da640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f4d280b9490 con 0x7f4d2815f690 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d307da640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f4d280d4160 con 0x7f4d2815f2b0 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d2dd75640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d2815f690 0x7f4d280d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.762+0000 7f4d2ed77640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d280d4f20 0x7f4d280b6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45876/0 (socket says 172.21.15.55:45876) 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2ed77640 1 -- 172.21.15.55:0/1310548042 learned_addr learned my addr 172.21.15.55:0/1310548042 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2e576640 1 --2- 172.21.15.55:0/1310548042 >> v2:172.21.15.64:3300/0 conn(0x7f4d2815f2b0 0x7f4d280d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2dd75640 1 -- 172.21.15.55:0/1310548042 >> v2:172.21.15.64:3300/0 conn(0x7f4d2815f2b0 msgr2=0x7f4d280d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2dd75640 1 --2- 172.21.15.55:0/1310548042 >> v2:172.21.15.64:3300/0 conn(0x7f4d2815f2b0 0x7f4d280d3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2dd75640 1 -- 172.21.15.55:0/1310548042 >> v1:172.21.15.55:6789/0 conn(0x7f4d280d4f20 legacy=0x7f4d280b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2dd75640 1 -- 172.21.15.55:0/1310548042 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d280d4440 con 0x7f4d2815f690 2024-05-10T03:54:02.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.763+0000 7f4d2e576640 1 --2- 172.21.15.55:0/1310548042 >> v2:172.21.15.64:3300/0 conn(0x7f4d2815f2b0 0x7f4d280d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:02.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d2dd75640 1 --2- 172.21.15.55:0/1310548042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d280d1d30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4d280d2ab0 tx=0x7f4d1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997c4a60f7ff8c05 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:02.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d2d574640 1 -- 172.21.15.55:0/1310548042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c037070 con 0x7f4d2815f690 2024-05-10T03:54:02.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d2d574640 1 -- 172.21.15.55:0/1310548042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c032440 con 0x7f4d2815f690 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d2d574640 1 -- 172.21.15.55:0/1310548042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c02ae60 con 0x7f4d2815f690 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 -- 172.21.15.55:0/1310548042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 msgr2=0x7f4d280d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 --2- 172.21.15.55:0/1310548042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d280d1d30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4d280d2ab0 tx=0x7f4d1c02a110 comp rx=0 tx=0).stop 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 -- 172.21.15.55:0/1310548042 shutdown_connections 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 --2- 172.21.15.55:0/1310548042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d280d1d30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 --2- 172.21.15.55:0/1310548042 >> v2:172.21.15.64:3300/0 conn(0x7f4d2815f2b0 0x7f4d280d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 -- 172.21.15.55:0/1310548042 >> 172.21.15.55:0/1310548042 conn(0x7f4d280740f0 msgr2=0x7f4d2806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 -- 172.21.15.55:0/1310548042 shutdown_connections 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.764+0000 7f4d307da640 1 -- 172.21.15.55:0/1310548042 wait complete. 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 Processor -- start 2024-05-10T03:54:02.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 -- start start 2024-05-10T03:54:02.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d280d4f20 0x7f4d2814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4d2815f2b0 0x7f4d281514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d28151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4d280bb230 con 0x7f4d2815f690 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4d280d47e0 con 0x7f4d280d4f20 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.766+0000 7f4d307da640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4d280d3960 con 0x7f4d2815f2b0 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d28151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d28151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54992/0 (socket says 172.21.15.55:54992) 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 -- 172.21.15.55:0/415323573 learned_addr learned my addr 172.21.15.55:0/415323573 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2dd75640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4d2815f2b0 0x7f4d281514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 -- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4d2815f2b0 msgr2=0x7f4d281514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4d2815f2b0 0x7f4d281514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2e576640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d280d4f20 0x7f4d2814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 -- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d280d4f20 msgr2=0x7f4d2814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d280d4f20 0x7f4d2814f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 -- 172.21.15.55:0/415323573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2815fa70 con 0x7f4d2815f690 2024-05-10T03:54:02.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d2ed77640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d28151a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800cbc0 tx=0x7f4d1800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18017070 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1800ad40 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18012600 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2815fd50 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.767+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d28160310 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.768+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2806a7e0 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.769+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d1801a070 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.769+0000 7f4d26ffd640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d140762d0 0x7f4d14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.769+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d18097380 con 0x7f4d2815f690 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.769+0000 7f4d2e576640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d140762d0 0x7f4d14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:02.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.770+0000 7f4d2e576640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d140762d0 0x7f4d14078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000d8b0 tx=0x7f4d20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:02.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.774+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4d180605f0 con 0x7f4d2815f690 2024-05-10T03:54:02.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.964+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4d2806c390 con 0x7f4d2815f690 2024-05-10T03:54:02.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.964+0000 7f4d26ffd640 1 -- 172.21.15.55:0/415323573 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f4d180648f0 con 0x7f4d2815f690 2024-05-10T03:54:02.968 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.966+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d140762d0 msgr2=0x7f4d14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.966+0000 7f4d307da640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d140762d0 0x7f4d14078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000d8b0 tx=0x7f4d20008040 comp rx=0 tx=0).stop 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.966+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 msgr2=0x7f4d28151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.966+0000 7f4d307da640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d28151a30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800cbc0 tx=0x7f4d1800a430 comp rx=0 tx=0).stop 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 shutdown_connections 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d140762d0 0x7f4d14078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d2815f690 0x7f4d28151a30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4d2815f2b0 0x7f4d281514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 --2- 172.21.15.55:0/415323573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d280d4f20 0x7f4d2814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 >> 172.21.15.55:0/415323573 conn(0x7f4d280740f0 msgr2=0x7f4d2815e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 shutdown_connections 2024-05-10T03:54:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:02.967+0000 7f4d307da640 1 -- 172.21.15.55:0/415323573 wait complete. 2024-05-10T03:54:02.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T03:54:03.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.084+0000 7f570bdc8640 1 Processor -- start 2024-05-10T03:54:03.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 -- start start 2024-05-10T03:54:03.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f2b0 0x7f57040d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f570415f690 0x7f57040d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57040d4f20 0x7f57040d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f57040d3e80 con 0x7f57040d4f20 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f57040d4160 con 0x7f570415f690 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.085+0000 7f570bdc8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f57040d4440 con 0x7f570415f2b0 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57040d4f20 0x7f57040d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57040d4f20 0x7f57040d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55008/0 (socket says 172.21.15.55:55008) 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 -- 172.21.15.55:0/3538975146 learned_addr learned my addr 172.21.15.55:0/3538975146 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f5709b64640 1 --2- 172.21.15.55:0/3538975146 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f2b0 0x7f57040d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 -- 172.21.15.55:0/3538975146 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f2b0 msgr2=0x7f57040d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:03.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 --2- 172.21.15.55:0/3538975146 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f2b0 0x7f57040d3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 -- 172.21.15.55:0/3538975146 >> v2:172.21.15.64:3300/0 conn(0x7f570415f690 msgr2=0x7f57040d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f5709363640 1 --2- 172.21.15.55:0/3538975146 >> v2:172.21.15.64:3300/0 conn(0x7f570415f690 0x7f57040d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 --2- 172.21.15.55:0/3538975146 >> v2:172.21.15.64:3300/0 conn(0x7f570415f690 0x7f57040d1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.086+0000 7f570a365640 1 -- 172.21.15.55:0/3538975146 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57040d4720 con 0x7f57040d4f20 2024-05-10T03:54:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570a365640 1 --2- 172.21.15.55:0/3538975146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040d4f20 0x7f57040d2270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57040d63e0 tx=0x7f56f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b667a669c42d71 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f5708b62640 1 -- 172.21.15.55:0/3538975146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4036070 con 0x7f57040d4f20 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f5708b62640 1 -- 172.21.15.55:0/3538975146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f4031600 con 0x7f57040d4f20 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f5708b62640 1 -- 172.21.15.55:0/3538975146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f40319d0 con 0x7f57040d4f20 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 -- 172.21.15.55:0/3538975146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040d4f20 msgr2=0x7f57040d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 --2- 172.21.15.55:0/3538975146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040d4f20 0x7f57040d2270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57040d63e0 tx=0x7f56f402a6a0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 -- 172.21.15.55:0/3538975146 shutdown_connections 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 --2- 172.21.15.55:0/3538975146 >> v2:172.21.15.64:3300/0 conn(0x7f570415f690 0x7f57040d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 --2- 172.21.15.55:0/3538975146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040d4f20 0x7f57040d2270 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 --2- 172.21.15.55:0/3538975146 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f2b0 0x7f57040d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 -- 172.21.15.55:0/3538975146 >> 172.21.15.55:0/3538975146 conn(0x7f57040740f0 msgr2=0x7f570406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 -- 172.21.15.55:0/3538975146 shutdown_connections 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.087+0000 7f570bdc8640 1 -- 172.21.15.55:0/3538975146 wait complete. 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 Processor -- start 2024-05-10T03:54:03.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 -- start start 2024-05-10T03:54:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57040d4f20 0x7f5704153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 0x7f57040ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f690 0x7f57040cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f57040d3960 con 0x7f570415f2b0 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f57040bb230 con 0x7f57040d4f20 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f570bdc8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f57040d3ae0 con 0x7f570415f690 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.089+0000 7f5709363640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 0x7f57040ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 0x7f57040ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55014/0 (socket says 172.21.15.55:55014) 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 -- 172.21.15.55:0/2934065870 learned_addr learned my addr 172.21.15.55:0/2934065870 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f570a365640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f690 0x7f57040cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709b64640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57040d4f20 0x7f5704153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 -- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f690 msgr2=0x7f57040cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f690 0x7f57040cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 -- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57040d4f20 msgr2=0x7f5704153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57040d4f20 0x7f5704153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 -- 172.21.15.55:0/2934065870 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5704156a80 con 0x7f570415f2b0 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f5709363640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 0x7f57040ceaf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c7f0 tx=0x7f56f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8015070 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f8004220 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f8007620 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5704156d60 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.090+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5704157320 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.091+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570406a7e0 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.092+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56f80079d0 con 0x7f570415f2b0 2024-05-10T03:54:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.092+0000 7f57027fc640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56f00762d0 0x7f56f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.092+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56f80977f0 con 0x7f570415f2b0 2024-05-10T03:54:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.092+0000 7f5709b64640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56f00762d0 0x7f56f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.093+0000 7f5709b64640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56f00762d0 0x7f56f0078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57040cbca0 tx=0x7f56fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.097+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56f8060b90 con 0x7f570415f2b0 2024-05-10T03:54:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.285+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5704160b80 con 0x7f570415f2b0 2024-05-10T03:54:03.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.286+0000 7f57027fc640 1 -- 172.21.15.55:0/2934065870 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f56f8064e90 con 0x7f570415f2b0 2024-05-10T03:54:03.288 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-10T03:54:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56f00762d0 msgr2=0x7f56f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56f00762d0 0x7f56f0078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57040cbca0 tx=0x7f56fc008040 comp rx=0 tx=0).stop 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 msgr2=0x7f57040ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 0x7f57040ceaf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c7f0 tx=0x7f56f800ccb0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 shutdown_connections 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f570415f690 0x7f57040cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56f00762d0 0x7f56f0078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f570415f2b0 0x7f57040ceaf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 --2- 172.21.15.55:0/2934065870 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f57040d4f20 0x7f5704153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.287+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 >> 172.21.15.55:0/2934065870 conn(0x7f57040740f0 msgr2=0x7f570415c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.288+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 shutdown_connections 2024-05-10T03:54:03.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.288+0000 7f570bdc8640 1 -- 172.21.15.55:0/2934065870 wait complete. 2024-05-10T03:54:03.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T03:54:03.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.407+0000 7fbd08771640 1 Processor -- start 2024-05-10T03:54:03.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.407+0000 7fbd08771640 1 -- start start 2024-05-10T03:54:03.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.408+0000 7fbd08771640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd0015f440 0x7fbd000b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.408+0000 7fbd08771640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd000d2200 0x7fbd000d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.408+0000 7fbd08771640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd000d0530 con 0x7fbd00163a00 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.408+0000 7fbd08771640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fbd000d36e0 con 0x7fbd0015f440 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.408+0000 7fbd08771640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbd000d0810 con 0x7fbd000d2200 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.408+0000 7fbd0650d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd0015f440 0x7fbd000b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd0650d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd0015f440 0x7fbd000b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55016/0 (socket says 172.21.15.55:55016) 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd0650d640 1 -- 172.21.15.55:0/3221590525 learned_addr learned my addr 172.21.15.55:0/3221590525 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd06d0e640 1 --2- 172.21.15.55:0/3221590525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd000d2200 0x7fbd000d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd0650d640 1 -- 172.21.15.55:0/3221590525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd000d2200 msgr2=0x7fbd000d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd0650d640 1 --2- 172.21.15.55:0/3221590525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd000d2200 0x7fbd000d3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd0650d640 1 -- 172.21.15.55:0/3221590525 >> v1:172.21.15.64:6789/0 conn(0x7fbd00163a00 legacy=0x7fbd000d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.409+0000 7fbd0650d640 1 -- 172.21.15.55:0/3221590525 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd000d0af0 con 0x7fbd0015f440 2024-05-10T03:54:03.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd0650d640 1 --2- 172.21.15.55:0/3221590525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd0015f440 0x7fbd000b3f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009870 tx=0x7fbcf802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1039e7ce5293e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd0550b640 1 -- 172.21.15.55:0/3221590525 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8037070 con 0x7fbd0015f440 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd0550b640 1 -- 172.21.15.55:0/3221590525 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf8032440 con 0x7fbd0015f440 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd0550b640 1 -- 172.21.15.55:0/3221590525 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8032810 con 0x7fbd0015f440 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 -- 172.21.15.55:0/3221590525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd0015f440 msgr2=0x7fbd000b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 --2- 172.21.15.55:0/3221590525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd0015f440 0x7fbd000b3f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009870 tx=0x7fbcf802a1c0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 -- 172.21.15.55:0/3221590525 shutdown_connections 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 --2- 172.21.15.55:0/3221590525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd000d2200 0x7fbd000d3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 --2- 172.21.15.55:0/3221590525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd0015f440 0x7fbd000b3f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 -- 172.21.15.55:0/3221590525 >> 172.21.15.55:0/3221590525 conn(0x7fbd000740f0 msgr2=0x7fbd0006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 -- 172.21.15.55:0/3221590525 shutdown_connections 2024-05-10T03:54:03.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.410+0000 7fbd08771640 1 -- 172.21.15.55:0/3221590525 wait complete. 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 Processor -- start 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 -- start start 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 0x7fbd00161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd0015f440 0x7fbd000cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd00163a00 0x7fbd00161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000b47a0 con 0x7fbd000d2200 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd000b4620 con 0x7fbd00163a00 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd08771640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbd000d40b0 con 0x7fbd0015f440 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd0650d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 0x7fbd00161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd0650d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 0x7fbd00161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55024/0 (socket says 172.21.15.55:55024) 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.412+0000 7fbd0650d640 1 -- 172.21.15.55:0/668796645 learned_addr learned my addr 172.21.15.55:0/668796645 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd05d0c640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd0015f440 0x7fbd000cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd0650d640 1 -- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd0015f440 msgr2=0x7fbd000cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd06d0e640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd00163a00 0x7fbd00161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd0650d640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd0015f440 0x7fbd000cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd0650d640 1 -- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd00163a00 msgr2=0x7fbd00161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd0650d640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd00163a00 0x7fbd00161b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd0650d640 1 -- 172.21.15.55:0/668796645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd000b6260 con 0x7fbd000d2200 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd05d0c640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd0015f440 0x7fbd000cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd0650d640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 0x7fbd00161280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8000c00 tx=0x7fbcf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8041020 con 0x7fbd000d2200 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf80306c0 con 0x7fbd000d2200 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8037040 con 0x7fbd000d2200 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd000b6540 con 0x7fbd000d2200 2024-05-10T03:54:03.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.413+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd000b6b00 con 0x7fbd000d2200 2024-05-10T03:54:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.414+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0006a7e0 con 0x7fbd000d2200 2024-05-10T03:54:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.415+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbcf8044020 con 0x7fbd000d2200 2024-05-10T03:54:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.415+0000 7fbcfeffd640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbcec0762d0 0x7fbcec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.415+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbcf80b7e50 con 0x7fbd000d2200 2024-05-10T03:54:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.415+0000 7fbd05d0c640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbcec0762d0 0x7fbcec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.416+0000 7fbd05d0c640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbcec0762d0 0x7fbcec078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd00158690 tx=0x7fbcf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.420+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbcf804b030 con 0x7fbd000d2200 2024-05-10T03:54:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.608+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd00162e90 con 0x7fbd000d2200 2024-05-10T03:54:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.608+0000 7fbcfeffd640 1 -- 172.21.15.55:0/668796645 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fbcf80817a0 con 0x7fbd000d2200 2024-05-10T03:54:03.611 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-10T03:54:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbcec0762d0 msgr2=0x7fbcec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbcec0762d0 0x7fbcec078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd00158690 tx=0x7fbcf4009040 comp rx=0 tx=0).stop 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 msgr2=0x7fbd00161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 0x7fbd00161280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8000c00 tx=0x7fbcf80046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 shutdown_connections 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd00163a00 0x7fbd00161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd0015f440 0x7fbd000cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbcec0762d0 0x7fbcec078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 --2- 172.21.15.55:0/668796645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd000d2200 0x7fbd00161280 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 >> 172.21.15.55:0/668796645 conn(0x7fbd000740f0 msgr2=0x7fbd000b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.610+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 shutdown_connections 2024-05-10T03:54:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.611+0000 7fbd08771640 1 -- 172.21.15.55:0/668796645 wait complete. 2024-05-10T03:54:03.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-05-10T03:54:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.726+0000 7f82cf483640 1 Processor -- start 2024-05-10T03:54:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.726+0000 7f82cf483640 1 -- start start 2024-05-10T03:54:03.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cf483640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f82c80b44c0 0x7f82c809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cf483640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80cd7d0 con 0x7f82c80b5660 2024-05-10T03:54:03.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cf483640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80cdab0 con 0x7f82c80d2180 2024-05-10T03:54:03.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cf483640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f82c80b48a0 con 0x7f82c80b44c0 2024-05-10T03:54:03.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cca1e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f82c80b5660 0x7f82c80ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45892/0 (socket says 172.21.15.55:45892) 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cca1e640 1 -- 172.21.15.55:0/3907963035 learned_addr learned my addr 172.21.15.55:0/3907963035 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82cd21f640 1 --2- 172.21.15.55:0/3907963035 >> v2:172.21.15.64:3300/0 conn(0x7f82c80b44c0 0x7f82c809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015487476 0 0) 0x7f82c80cd7d0 con 0x7f82c80b5660 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b4003520 con 0x7f82c80b5660 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059666726 0 0) 0x7f82c80cdab0 con 0x7f82c80d2180 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c80cd7d0 con 0x7f82c80d2180 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 666985389 0 0) 0x7f82b4003520 con 0x7f82c80b5660 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 >> v2:172.21.15.64:3300/0 conn(0x7f82c80b44c0 msgr2=0x7f82c809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 --2- 172.21.15.55:0/3907963035 >> v2:172.21.15.64:3300/0 conn(0x7f82c80b44c0 0x7f82c809ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 >> v1:172.21.15.64:6789/0 conn(0x7f82c80d2180 legacy=0x7f82c80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80cdd90 con 0x7f82c80b5660 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f82b80016f0 con 0x7f82c80b5660 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 >> v1:172.21.15.55:6789/0 conn(0x7f82c80b5660 legacy=0x7f82c80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4003c30 0x7f82b4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b4004800 0x7f82b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.727+0000 7f82bffff640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4005280 0x7f82b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80b48a0 con 0x7f82b4005280 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82b400c1c0 con 0x7f82b4003c30 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f82b400c3c0 con 0x7f82b4004800 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cda20640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4005280 0x7f82b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cca1e640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b4004800 0x7f82b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cd21f640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4003c30 0x7f82b4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cda20640 1 -- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b4004800 msgr2=0x7f82b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cda20640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82b4004800 0x7f82b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cda20640 1 -- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4003c30 msgr2=0x7f82b4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cda20640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4003c30 0x7f82b4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.728+0000 7f82cda20640 1 -- 172.21.15.55:0/3907963035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b4003520 con 0x7f82b4005280 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cda20640 1 -- 172.21.15.55:0/3907963035 reap_dead start 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cda20640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4005280 0x7f82b400b9c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f82c0002000 tx=0x7f82b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd26c24622b4573 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0001c20 con 0x7f82b4005280 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c0003b70 con 0x7f82b4005280 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82bffff640 1 -- 172.21.15.55:0/3907963035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00050d0 con 0x7f82b4005280 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cf483640 1 -- 172.21.15.55:0/3907963035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4005280 msgr2=0x7f82b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cf483640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4005280 0x7f82b400b9c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f82c0002000 tx=0x7f82b4005830 comp rx=0 tx=0).stop 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cf483640 1 -- 172.21.15.55:0/3907963035 shutdown_connections 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cf483640 1 --2- 172.21.15.55:0/3907963035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82b4005280 0x7f82b400b9c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.729+0000 7f82cf483640 1 -- 172.21.15.55:0/3907963035 >> 172.21.15.55:0/3907963035 conn(0x7f82c80b4b40 msgr2=0x7f82c80b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.730+0000 7f82cf483640 1 -- 172.21.15.55:0/3907963035 shutdown_connections 2024-05-10T03:54:03.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.730+0000 7f82cf483640 1 -- 172.21.15.55:0/3907963035 wait complete. 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.731+0000 7f82cf483640 1 Processor -- start 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.731+0000 7f82cf483640 1 -- start start 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cf483640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4005280 0x7f82c81533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cf483640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82c80c9310 0x7f82c80c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cf483640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 0x7f82c80b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cf483640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f82c806e310 con 0x7f82c80c9770 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cf483640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f82c806e6b0 con 0x7f82b4005280 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cf483640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f82c806e490 con 0x7f82c80c9310 2024-05-10T03:54:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 0x7f82c80b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 0x7f82c80b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55054/0 (socket says 172.21.15.55:55054) 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 -- 172.21.15.55:0/306257660 learned_addr learned my addr 172.21.15.55:0/306257660 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cd21f640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4005280 0x7f82c81533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cca1e640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82c80c9310 0x7f82c80c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 -- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82c80c9310 msgr2=0x7f82c80c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82c80c9310 0x7f82c80c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 -- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4005280 msgr2=0x7f82c81533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4005280 0x7f82c81533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 -- 172.21.15.55:0/306257660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80c6d90 con 0x7f82c80c9770 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82cda20640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 0x7f82c80b5b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f82c0002120 tx=0x7f82c0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.732+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0040070 con 0x7f82c80c9770 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.733+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c0035070 con 0x7f82c80c9770 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.733+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031830 con 0x7f82c80c9770 2024-05-10T03:54:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.733+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c80c7070 con 0x7f82c80c9770 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.733+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c80c7630 con 0x7f82c80c9770 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.734+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c806a7e0 con 0x7f82c80c9770 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.734+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82c0043070 con 0x7f82c80c9770 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.735+0000 7f82bdffb640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82ac0762d0 0x7f82ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.735+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82c00b7110 con 0x7f82c80c9770 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.735+0000 7f82cd21f640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82ac0762d0 0x7f82ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.735+0000 7f82cd21f640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82ac0762d0 0x7f82ac078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009b40 tx=0x7f82c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:03.739+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82c0080a90 con 0x7f82c80c9770 2024-05-10T03:54:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.002+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7f82c8068600 con 0x7f82c80c9770 2024-05-10T03:54:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.389+0000 7f82bdffb640 1 -- 172.21.15.55:0/306257660 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v43) ==== 126+0+0 (secure 0 0 0) 0x7f82c0080390 con 0x7f82c80c9770 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82ac0762d0 msgr2=0x7f82ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82ac0762d0 0x7f82ac078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009b40 tx=0x7f82c4009190 comp rx=0 tx=0).stop 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 msgr2=0x7f82c80b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 0x7f82c80b5b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f82c0002120 tx=0x7f82c0001670 comp rx=0 tx=0).stop 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 shutdown_connections 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f82ac0762d0 0x7f82ac078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80c9770 0x7f82c80b5b20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f82c80c9310 0x7f82c80c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 --2- 172.21.15.55:0/306257660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f82b4005280 0x7f82c81533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 >> 172.21.15.55:0/306257660 conn(0x7f82c80b4b40 msgr2=0x7f82c80b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:04.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 shutdown_connections 2024-05-10T03:54:04.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.392+0000 7f82cf483640 1 -- 172.21.15.55:0/306257660 wait complete. 2024-05-10T03:54:04.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T03:54:04.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.514+0000 7f64514e1640 1 Processor -- start 2024-05-10T03:54:04.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.514+0000 7f64514e1640 1 -- start start 2024-05-10T03:54:04.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f64514e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f644c15f3c0 0x7f644c0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:04.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f64514e1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f644c0d06b0 0x7f644c0d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f64514e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c0d3c50 con 0x7f644c0bac60 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f64514e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f644c0d3f30 con 0x7f644c15f3c0 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f64514e1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f644c0d4210 con 0x7f644c0d06b0 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f644affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f644c15f3c0 0x7f644c0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f644affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f644c15f3c0 0x7f644c0d3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55066/0 (socket says 172.21.15.55:55066) 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f644affd640 1 -- 172.21.15.55:0/1396971823 learned_addr learned my addr 172.21.15.55:0/1396971823 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.515+0000 7f644a7fc640 1 --1- 172.21.15.55:0/1396971823 >> v1:172.21.15.55:6789/0 conn(0x7f644c0bac60 0x7f644c0cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45898/0 (socket says 172.21.15.55:45898) 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f644b7fe640 1 --2- 172.21.15.55:0/1396971823 >> v2:172.21.15.64:3300/0 conn(0x7f644c0d06b0 0x7f644c0d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f644affd640 1 -- 172.21.15.55:0/1396971823 >> v2:172.21.15.64:3300/0 conn(0x7f644c0d06b0 msgr2=0x7f644c0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f644affd640 1 --2- 172.21.15.55:0/1396971823 >> v2:172.21.15.64:3300/0 conn(0x7f644c0d06b0 0x7f644c0d1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f644affd640 1 -- 172.21.15.55:0/1396971823 >> v1:172.21.15.55:6789/0 conn(0x7f644c0bac60 legacy=0x7f644c0cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f644affd640 1 -- 172.21.15.55:0/1396971823 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c0d44f0 con 0x7f644c15f3c0 2024-05-10T03:54:04.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f644affd640 1 --2- 172.21.15.55:0/1396971823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c15f3c0 0x7f644c0d3370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f644c08ddb0 tx=0x7f644402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3852a328919d606 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f6449ffb640 1 -- 172.21.15.55:0/1396971823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444037070 con 0x7f644c15f3c0 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f6449ffb640 1 -- 172.21.15.55:0/1396971823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444032440 con 0x7f644c15f3c0 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.516+0000 7f6449ffb640 1 -- 172.21.15.55:0/1396971823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444032810 con 0x7f644c15f3c0 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 -- 172.21.15.55:0/1396971823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c15f3c0 msgr2=0x7f644c0d3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 --2- 172.21.15.55:0/1396971823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c15f3c0 0x7f644c0d3370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f644c08ddb0 tx=0x7f644402a270 comp rx=0 tx=0).stop 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 -- 172.21.15.55:0/1396971823 shutdown_connections 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 --2- 172.21.15.55:0/1396971823 >> v2:172.21.15.64:3300/0 conn(0x7f644c0d06b0 0x7f644c0d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 --2- 172.21.15.55:0/1396971823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c15f3c0 0x7f644c0d3370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 -- 172.21.15.55:0/1396971823 >> 172.21.15.55:0/1396971823 conn(0x7f644c073ee0 msgr2=0x7f644c0742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 -- 172.21.15.55:0/1396971823 shutdown_connections 2024-05-10T03:54:04.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.517+0000 7f64514e1640 1 -- 172.21.15.55:0/1396971823 wait complete. 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.518+0000 7f64514e1640 1 Processor -- start 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.518+0000 7f64514e1640 1 -- start start 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f64514e1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f644c0bac60 0x7f644c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f64514e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 0x7f644c0b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f64514e1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f644c15f3c0 0x7f644c0b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f64514e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0d3a30 con 0x7f644c0d06b0 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f64514e1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0d38b0 con 0x7f644c0bac60 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f64514e1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f644c15f7a0 con 0x7f644c15f3c0 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f644a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 0x7f644c0b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f644a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 0x7f644c0b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55068/0 (socket says 172.21.15.55:55068) 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f644a7fc640 1 -- 172.21.15.55:0/1845213964 learned_addr learned my addr 172.21.15.55:0/1845213964 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f644affd640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f644c0bac60 0x7f644c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:04.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.519+0000 7f644b7fe640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f644c15f3c0 0x7f644c0b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644a7fc640 1 -- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f644c15f3c0 msgr2=0x7f644c0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644a7fc640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f644c15f3c0 0x7f644c0b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644a7fc640 1 -- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f644c0bac60 msgr2=0x7f644c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644a7fc640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f644c0bac60 0x7f644c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644a7fc640 1 -- 172.21.15.55:0/1845213964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c15e5c0 con 0x7f644c0d06b0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644b7fe640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f644c15f3c0 0x7f644c0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f644a7fc640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 0x7f644c0b6d50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f643400c4d0 tx=0x7f643400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434018070 con 0x7f644c0d06b0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6434007480 con 0x7f644c0d06b0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1f5650 con 0x7f644c0d06b0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64340049e0 con 0x7f644c0d06b0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.520+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1f5c10 con 0x7f644c0d06b0 2024-05-10T03:54:04.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.521+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c06a7e0 con 0x7f644c0d06b0 2024-05-10T03:54:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.522+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6434004b80 con 0x7f644c0d06b0 2024-05-10T03:54:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.522+0000 7f64437fe640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f642c0762d0 0x7f642c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.522+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6434096830 con 0x7f644c0d06b0 2024-05-10T03:54:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.522+0000 7f644affd640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f642c0762d0 0x7f642c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:04.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.523+0000 7f644affd640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f642c0762d0 0x7f642c078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6444034000 tx=0x7f644402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:04.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.527+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6434007670 con 0x7f644c0d06b0 2024-05-10T03:54:04.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.719+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f644c0b9c80 con 0x7f644c0d06b0 2024-05-10T03:54:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.726+0000 7f64437fe640 1 -- 172.21.15.55:0/1845213964 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f643405fac0 con 0x7f644c0d06b0 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.728+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f642c0762d0 msgr2=0x7f642c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.728+0000 7f64514e1640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f642c0762d0 0x7f642c078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6444034000 tx=0x7f644402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.728+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 msgr2=0x7f644c0b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.728+0000 7f64514e1640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 0x7f644c0b6d50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f643400c4d0 tx=0x7f643400c990 comp rx=0 tx=0).stop 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 shutdown_connections 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f644c15f3c0 0x7f644c0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f642c0762d0 0x7f642c078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f644c0d06b0 0x7f644c0b6d50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 --2- 172.21.15.55:0/1845213964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f644c0bac60 0x7f644c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 >> 172.21.15.55:0/1845213964 conn(0x7f644c073ee0 msgr2=0x7f644c156730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 shutdown_connections 2024-05-10T03:54:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:04.729+0000 7f64514e1640 1 -- 172.21.15.55:0/1845213964 wait complete. 2024-05-10T03:54:04.743 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T03:54:04.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T03:54:04.786 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T03:54:04.838 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T03:54:04.838 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:04.838 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:04.855 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:04.855 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:04.912 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:04.912 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:04.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:54:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.111+0000 7f2607519640 1 Processor -- start 2024-05-10T03:54:05.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.111+0000 7f2607519640 1 -- start start 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2607519640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f260009c170 0x7f26000d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2607519640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26000cd7d0 con 0x7f26000b5660 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2607519640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26000cdab0 con 0x7f26000b44c0 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2607519640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f26000b48a0 con 0x7f260009c170 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2605ab6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26000b5660 0x7f26000d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45910/0 (socket says 172.21.15.55:45910) 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2605ab6640 1 -- 172.21.15.55:0/4123077517 learned_addr learned my addr 172.21.15.55:0/4123077517 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2604ab4640 1 --2- 172.21.15.55:0/4123077517 >> v2:172.21.15.64:3300/0 conn(0x7f260009c170 0x7f26000d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f25f7fff640 1 -- 172.21.15.55:0/4123077517 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601827866 0 0) 0x7f26000cd7d0 con 0x7f26000b5660 2024-05-10T03:54:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f25f7fff640 1 -- 172.21.15.55:0/4123077517 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25ec003520 con 0x7f26000b5660 2024-05-10T03:54:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2604ab4640 1 -- 172.21.15.55:0/4123077517 >> v1:172.21.15.64:6789/0 conn(0x7f26000b44c0 legacy=0x7f260009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2604ab4640 1 -- 172.21.15.55:0/4123077517 >> v1:172.21.15.55:6789/0 conn(0x7f26000b5660 legacy=0x7f26000d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.112+0000 7f2604ab4640 1 -- 172.21.15.55:0/4123077517 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26000cdd90 con 0x7f260009c170 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.113+0000 7f2604ab4640 1 --2- 172.21.15.55:0/4123077517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26000d1170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26000b4a20 tx=0x7f25f002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c670e2fca0cc2e87 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.113+0000 7f25f7fff640 1 -- 172.21.15.55:0/4123077517 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0037070 con 0x7f260009c170 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.113+0000 7f25f7fff640 1 -- 172.21.15.55:0/4123077517 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f0032440 con 0x7f260009c170 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.113+0000 7f25f7fff640 1 -- 172.21.15.55:0/4123077517 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f00327f0 con 0x7f260009c170 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 -- 172.21.15.55:0/4123077517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 msgr2=0x7f26000d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 --2- 172.21.15.55:0/4123077517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26000d1170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26000b4a20 tx=0x7f25f002a180 comp rx=0 tx=0).stop 2024-05-10T03:54:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 -- 172.21.15.55:0/4123077517 shutdown_connections 2024-05-10T03:54:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 --2- 172.21.15.55:0/4123077517 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26000d1170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 -- 172.21.15.55:0/4123077517 >> 172.21.15.55:0/4123077517 conn(0x7f26000b4b40 msgr2=0x7f26000b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 -- 172.21.15.55:0/4123077517 shutdown_connections 2024-05-10T03:54:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.114+0000 7f2607519640 1 -- 172.21.15.55:0/4123077517 wait complete. 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.115+0000 7f2607519640 1 Processor -- start 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.115+0000 7f2607519640 1 -- start start 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2607519640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26001f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2607519640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 0x7f260015d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2607519640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f26000b5660 0x7f260015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2607519640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f260006e310 con 0x7f26000b44c0 2024-05-10T03:54:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2607519640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f260006e6b0 con 0x7f260009c170 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2607519640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f260006e490 con 0x7f26000b5660 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 0x7f260015d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 0x7f260015d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55078/0 (socket says 172.21.15.55:55078) 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 -- 172.21.15.55:0/813134666 learned_addr learned my addr 172.21.15.55:0/813134666 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f26052b5640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26001f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2605ab6640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f26000b5660 0x7f260015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 -- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f26000b5660 msgr2=0x7f260015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f26000b5660 0x7f260015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 -- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 msgr2=0x7f26001f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26001f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2604ab4640 1 -- 172.21.15.55:0/813134666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26000c8810 con 0x7f26000b44c0 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.116+0000 7f2605ab6640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f26000b5660 0x7f260015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.117+0000 7f2604ab4640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 0x7f260015d8b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f25f0035040 tx=0x7f25f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.117+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0037050 con 0x7f26000b44c0 2024-05-10T03:54:05.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.117+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f0038040 con 0x7f26000b44c0 2024-05-10T03:54:05.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.117+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0004450 con 0x7f26000b44c0 2024-05-10T03:54:05.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.117+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26000c8af0 con 0x7f26000b44c0 2024-05-10T03:54:05.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.117+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26000ca4a0 con 0x7f26000b44c0 2024-05-10T03:54:05.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.118+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260006ec60 con 0x7f26000b44c0 2024-05-10T03:54:05.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.119+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f25f003c6d0 con 0x7f26000b44c0 2024-05-10T03:54:05.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.119+0000 7f25f5ffb640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f25e40762d0 0x7f25e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.120+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f25f00b7ff0 con 0x7f26000b44c0 2024-05-10T03:54:05.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.120+0000 7f26052b5640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f25e40762d0 0x7f25e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.120+0000 7f26052b5640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f25e40762d0 0x7f25e4078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f25fc000f60 tx=0x7f25fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.124+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f260006ec60 con 0x7f26000b44c0 2024-05-10T03:54:05.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.327+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26000d2dc0 con 0x7f26000b44c0 2024-05-10T03:54:05.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.327+0000 7f25f5ffb640 1 -- 172.21.15.55:0/813134666 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f25f0081960 con 0x7f26000b44c0 2024-05-10T03:54:05.330 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-10T03:54:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f25e40762d0 msgr2=0x7f25e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f25e40762d0 0x7f25e4078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f25fc000f60 tx=0x7f25fc009040 comp rx=0 tx=0).stop 2024-05-10T03:54:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 msgr2=0x7f260015d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 0x7f260015d8b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f25f0035040 tx=0x7f25f00046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 shutdown_connections 2024-05-10T03:54:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f26000b5660 0x7f260015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f25e40762d0 0x7f25e4078790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26000b44c0 0x7f260015d8b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 --2- 172.21.15.55:0/813134666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f260009c170 0x7f26001f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 >> 172.21.15.55:0/813134666 conn(0x7f26000b4b40 msgr2=0x7f26000b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:05.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 shutdown_connections 2024-05-10T03:54:05.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.329+0000 7f2607519640 1 -- 172.21.15.55:0/813134666 wait complete. 2024-05-10T03:54:05.343 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T03:54:05.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:05.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-10T03:54:05.370 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:54:05.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:05.371 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T03:54:05.435 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:05.436 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:05.456 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:05.456 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:05.515 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:05.515 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:05.574 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:54:05.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.676+0000 7fe5904fc640 1 Processor -- start 2024-05-10T03:54:05.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.676+0000 7fe5904fc640 1 -- start start 2024-05-10T03:54:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe5904fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe588157760 0x7fe5880b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe5904fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe5880b3200 0x7fe588073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe5904fc640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5880732a0 con 0x7fe588073f70 2024-05-10T03:54:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe5904fc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fe588161940 con 0x7fe588157760 2024-05-10T03:54:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe5904fc640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fe588157b40 con 0x7fe5880b3200 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58e298640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe588157760 0x7fe5880b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58e298640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe588157760 0x7fe5880b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52642/0 (socket says 172.21.15.55:52642) 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58e298640 1 -- 172.21.15.55:0/1627615369 learned_addr learned my addr 172.21.15.55:0/1627615369 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58da97640 1 --2- 172.21.15.55:0/1627615369 >> v2:172.21.15.64:3300/0 conn(0x7fe5880b3200 0x7fe588073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58e298640 1 -- 172.21.15.55:0/1627615369 >> v2:172.21.15.64:3300/0 conn(0x7fe5880b3200 msgr2=0x7fe588073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58e298640 1 --2- 172.21.15.55:0/1627615369 >> v2:172.21.15.64:3300/0 conn(0x7fe5880b3200 0x7fe588073a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.677+0000 7fe58e298640 1 -- 172.21.15.55:0/1627615369 >> v1:172.21.15.64:6789/0 conn(0x7fe588073f70 legacy=0x7fe5880ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.678+0000 7fe58e298640 1 -- 172.21.15.55:0/1627615369 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe588160d30 con 0x7fe588157760 2024-05-10T03:54:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.678+0000 7fe58e298640 1 --2- 172.21.15.55:0/1627615369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588157760 0x7fe5880b2cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe5880b63d0 tx=0x7fe58002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6828d64f02613 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.678+0000 7fe58d296640 1 -- 172.21.15.55:0/1627615369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580037070 con 0x7fe588157760 2024-05-10T03:54:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.678+0000 7fe58d296640 1 -- 172.21.15.55:0/1627615369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe580032440 con 0x7fe588157760 2024-05-10T03:54:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.678+0000 7fe58d296640 1 -- 172.21.15.55:0/1627615369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580032810 con 0x7fe588157760 2024-05-10T03:54:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 -- 172.21.15.55:0/1627615369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588157760 msgr2=0x7fe5880b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 --2- 172.21.15.55:0/1627615369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588157760 0x7fe5880b2cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe5880b63d0 tx=0x7fe58002a140 comp rx=0 tx=0).stop 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 -- 172.21.15.55:0/1627615369 shutdown_connections 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 --2- 172.21.15.55:0/1627615369 >> v2:172.21.15.64:3300/0 conn(0x7fe5880b3200 0x7fe588073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 --2- 172.21.15.55:0/1627615369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588157760 0x7fe5880b2cc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 -- 172.21.15.55:0/1627615369 >> 172.21.15.55:0/1627615369 conn(0x7fe58806fac0 msgr2=0x7fe58806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 -- 172.21.15.55:0/1627615369 shutdown_connections 2024-05-10T03:54:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.679+0000 7fe5904fc640 1 -- 172.21.15.55:0/1627615369 wait complete. 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.680+0000 7fe5904fc640 1 Processor -- start 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.680+0000 7fe5904fc640 1 -- start start 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe5904fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 0x7fe5880b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe5904fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5880b3200 0x7fe588147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe5904fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe588157760 0x7fe5881e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe5904fc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881615d0 con 0x7fe588073f70 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe5904fc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881612f0 con 0x7fe588157760 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe5904fc640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe58815e860 con 0x7fe5880b3200 2024-05-10T03:54:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 0x7fe5880b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 0x7fe5880b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52646/0 (socket says 172.21.15.55:52646) 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 -- 172.21.15.55:0/2109575738 learned_addr learned my addr 172.21.15.55:0/2109575738 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 -- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5880b3200 msgr2=0x7fe588147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5880b3200 0x7fe588147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58ea99640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe588157760 0x7fe5881e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 -- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe588157760 msgr2=0x7fe5881e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe588157760 0x7fe5881e6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.681+0000 7fe58e298640 1 -- 172.21.15.55:0/2109575738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5880b0ca0 con 0x7fe588073f70 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.682+0000 7fe58e298640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 0x7fe5880b2000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe580000c00 tx=0x7fe5800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.682+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580041020 con 0x7fe588073f70 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.682+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe580030970 con 0x7fe588073f70 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.682+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5880b0f60 con 0x7fe588073f70 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.682+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580037040 con 0x7fe588073f70 2024-05-10T03:54:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.682+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5880b1520 con 0x7fe588073f70 2024-05-10T03:54:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.683+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5880b3000 con 0x7fe588073f70 2024-05-10T03:54:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.684+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe580044020 con 0x7fe588073f70 2024-05-10T03:54:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.684+0000 7fe586ffd640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe5740762d0 0x7fe574078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:05.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.684+0000 7fe58da97640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe5740762d0 0x7fe574078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:05.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.684+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe5800b7c60 con 0x7fe588073f70 2024-05-10T03:54:05.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.685+0000 7fe58da97640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe5740762d0 0x7fe574078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006fd0 tx=0x7fe57c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.689+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe5880b3000 con 0x7fe588073f70 2024-05-10T03:54:05.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.896+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe58806a7e0 con 0x7fe588073f70 2024-05-10T03:54:05.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.897+0000 7fe586ffd640 1 -- 172.21.15.55:0/2109575738 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe58004b070 con 0x7fe588073f70 2024-05-10T03:54:05.900 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-10T03:54:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe5740762d0 msgr2=0x7fe574078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe5740762d0 0x7fe574078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006fd0 tx=0x7fe57c008040 comp rx=0 tx=0).stop 2024-05-10T03:54:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 msgr2=0x7fe5880b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 0x7fe5880b2000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe580000c00 tx=0x7fe5800046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 shutdown_connections 2024-05-10T03:54:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe588157760 0x7fe5881e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5880b3200 0x7fe588147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe5740762d0 0x7fe574078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 --2- 172.21.15.55:0/2109575738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe588073f70 0x7fe5880b2000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 >> 172.21.15.55:0/2109575738 conn(0x7fe58806fac0 msgr2=0x7fe58815b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 shutdown_connections 2024-05-10T03:54:05.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:05.899+0000 7fe5904fc640 1 -- 172.21.15.55:0/2109575738 wait complete. 2024-05-10T03:54:05.913 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-10T03:54:05.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:05.913 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-10T03:54:05.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:54:05.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:05.947 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-10T03:54:06.017 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:06.017 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:06.034 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:06.034 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:06.091 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:06.091 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:06.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:54:06.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.289+0000 7f1dfc81d640 1 Processor -- start 2024-05-10T03:54:06.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.289+0000 7f1dfc81d640 1 -- start start 2024-05-10T03:54:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1dfc81d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1df815f830 0x7f1df80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1dfc81d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 0x7f1df80d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1dfc81d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1df80b5da0 con 0x7f1df815f450 2024-05-10T03:54:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1dfc81d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f1df8163460 con 0x7f1df815f830 2024-05-10T03:54:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1dfc81d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1df80b6080 con 0x7f1df80b5740 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1df815f450 0x7f1df80cfe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59134/0 (socket says 172.21.15.55:59134) 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df659c640 1 -- 172.21.15.55:0/1935119085 learned_addr learned my addr 172.21.15.55:0/1935119085 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/1935119085 >> v2:172.21.15.64:3300/0 conn(0x7f1df815f830 0x7f1df80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df6d9d640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 0x7f1df80d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037646500 0 0) 0x7f1df80b5da0 con 0x7f1df815f450 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de4003520 con 0x7f1df815f450 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1103327048 0 0) 0x7f1de4003520 con 0x7f1df815f450 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 msgr2=0x7f1df80d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 0x7f1df80d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 >> v2:172.21.15.64:3300/0 conn(0x7f1df815f830 msgr2=0x7f1df80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 --2- 172.21.15.55:0/1935119085 >> v2:172.21.15.64:3300/0 conn(0x7f1df815f830 0x7f1df80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df80d3020 con 0x7f1df815f450 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f1de80016f0 con 0x7f1df815f450 2024-05-10T03:54:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 >> v1:172.21.15.55:6789/0 conn(0x7f1df815f450 legacy=0x7f1df80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 0x7f1de4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1de4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1de4004d40 0x7f1de40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1df8163460 con 0x7f1de4003fd0 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1df80b6080 con 0x7f1de4004d40 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.290+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1de400ba10 con 0x7f1df80b5740 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1de4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1df659c640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 0x7f1de4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1df6d9d640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1de4004d40 0x7f1de40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 -- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 msgr2=0x7f1de4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df80b5740 0x7f1de4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 -- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1de4004d40 msgr2=0x7f1de40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1de4004d40 0x7f1de40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 -- 172.21.15.55:0/1935119085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de4003520 con 0x7f1de4003fd0 2024-05-10T03:54:06.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.291+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1de4004800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009ac0 tx=0x7f1de4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f593e4edaeae3d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de0036070 con 0x7f1de4003fd0 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de0031400 con 0x7f1de4003fd0 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1df5d9b640 1 -- 172.21.15.55:0/1935119085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de0009690 con 0x7f1de4003fd0 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1dfc81d640 1 -- 172.21.15.55:0/1935119085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 msgr2=0x7f1de4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/1935119085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1de4004800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009ac0 tx=0x7f1de4005830 comp rx=0 tx=0).stop 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1df6d9d640 1 -- 172.21.15.55:0/1935119085 reap_dead start 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1dfc81d640 1 -- 172.21.15.55:0/1935119085 shutdown_connections 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1dfc81d640 1 -- 172.21.15.55:0/1935119085 >> 172.21.15.55:0/1935119085 conn(0x7f1df808ec90 msgr2=0x7f1df809e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1dfc81d640 1 -- 172.21.15.55:0/1935119085 shutdown_connections 2024-05-10T03:54:06.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.292+0000 7f1dfc81d640 1 -- 172.21.15.55:0/1935119085 wait complete. 2024-05-10T03:54:06.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.294+0000 7f1dfc81d640 1 Processor -- start 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.294+0000 7f1dfc81d640 1 -- start start 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.294+0000 7f1dfc81d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1df80ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.294+0000 7f1dfc81d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df8160d10 0x7f1df8161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dfc81d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1df80b9f00 0x7f1df80ba380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dfc81d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1df80d5260 con 0x7f1de4003fd0 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dfc81d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1df80d0580 con 0x7f1df80b9f00 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dfc81d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1df80d53e0 con 0x7f1df8160d10 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1df80ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1df80ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52668/0 (socket says 172.21.15.55:52668) 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 -- 172.21.15.55:0/801232723 learned_addr learned my addr 172.21.15.55:0/801232723 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df8160d10 0x7f1df8161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df6d9d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1df80b9f00 0x7f1df80ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 -- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df8160d10 msgr2=0x7f1df8161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df8160d10 0x7f1df8161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 -- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1df80b9f00 msgr2=0x7f1df80ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1df80b9f00 0x7f1df80ba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 -- 172.21.15.55:0/801232723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df81eac10 con 0x7f1de4003fd0 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df8160d10 0x7f1df8161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df6d9d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1df80b9f00 0x7f1df80ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1df659c640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1df80ceb90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1de8007290 tx=0x7f1de8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de800f8e0 con 0x7f1de4003fd0 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de8018070 con 0x7f1de4003fd0 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df80cc440 con 0x7f1de4003fd0 2024-05-10T03:54:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de800fcc0 con 0x7f1de4003fd0 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.295+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df80cca00 con 0x7f1de4003fd0 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.296+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df806a7e0 con 0x7f1de4003fd0 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.297+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1de801d460 con 0x7f1de4003fd0 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.298+0000 7f1def7fe640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1dd80762d0 0x7f1dd8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.298+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1dd80762d0 0x7f1dd8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.298+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1de8097600 con 0x7f1de4003fd0 2024-05-10T03:54:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.298+0000 7f1dedd9b640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1dd80762d0 0x7f1dd8078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1de0033000 tx=0x7f1de0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.302+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1de800fe60 con 0x7f1de4003fd0 2024-05-10T03:54:06.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.506+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1df808f340 con 0x7f1de4003fd0 2024-05-10T03:54:06.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.506+0000 7f1def7fe640 1 -- 172.21.15.55:0/801232723 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f1de8060f60 con 0x7f1de4003fd0 2024-05-10T03:54:06.509 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-10T03:54:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1dd80762d0 msgr2=0x7f1dd8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1dd80762d0 0x7f1dd8078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1de0033000 tx=0x7f1de0008030 comp rx=0 tx=0).stop 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 msgr2=0x7f1df80ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1df80ceb90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1de8007290 tx=0x7f1de8007750 comp rx=0 tx=0).stop 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 shutdown_connections 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1df80b9f00 0x7f1df80ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1df8160d10 0x7f1df8161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1dd80762d0 0x7f1dd8078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 --2- 172.21.15.55:0/801232723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1de4003fd0 0x7f1df80ceb90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 >> 172.21.15.55:0/801232723 conn(0x7f1df808ec90 msgr2=0x7f1df80753b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 shutdown_connections 2024-05-10T03:54:06.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.508+0000 7f1dfc81d640 1 -- 172.21.15.55:0/801232723 wait complete. 2024-05-10T03:54:06.522 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-10T03:54:06.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:06.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-10T03:54:06.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:54:06.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:06.549 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-10T03:54:06.606 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:06.606 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:06.627 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:06.627 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:06.686 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:06.686 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:06.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:54:06.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.847+0000 7fac4df71640 1 Processor -- start 2024-05-10T03:54:06.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.847+0000 7fac4df71640 1 -- start start 2024-05-10T03:54:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac4df71640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac480b44c0 0x7fac4809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac4df71640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac4809bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac4df71640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fac480ce590 0x7fac480ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac4df71640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fac480b48a0 con 0x7fac480b44c0 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac4df71640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fac480cd7d0 con 0x7fac480ce590 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac4df71640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fac480cdab0 con 0x7fac480b5660 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac480b44c0 0x7fac4809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac480b44c0 0x7fac4809ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52678/0 (socket says 172.21.15.55:52678) 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 -- 172.21.15.55:0/4079299042 learned_addr learned my addr 172.21.15.55:0/4079299042 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac47fff640 1 --2- 172.21.15.55:0/4079299042 >> v2:172.21.15.64:3300/0 conn(0x7fac480ce590 0x7fac480ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac46ffd640 1 --2- 172.21.15.55:0/4079299042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac4809bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 -- 172.21.15.55:0/4079299042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 msgr2=0x7fac4809bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 --2- 172.21.15.55:0/4079299042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac4809bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 -- 172.21.15.55:0/4079299042 >> v2:172.21.15.64:3300/0 conn(0x7fac480ce590 msgr2=0x7fac480ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 --2- 172.21.15.55:0/4079299042 >> v2:172.21.15.64:3300/0 conn(0x7fac480ce590 0x7fac480ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.848+0000 7fac477fe640 1 -- 172.21.15.55:0/4079299042 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac480cdd90 con 0x7fac480b44c0 2024-05-10T03:54:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.849+0000 7fac477fe640 1 --2- 172.21.15.55:0/4079299042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac4809ba60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fac480cd600 tx=0x7fac3802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9863bf7a17d32f1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.849+0000 7fac467fc640 1 -- 172.21.15.55:0/4079299042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38037070 con 0x7fac480b44c0 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.849+0000 7fac467fc640 1 -- 172.21.15.55:0/4079299042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38032440 con 0x7fac480b44c0 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.849+0000 7fac467fc640 1 -- 172.21.15.55:0/4079299042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38032810 con 0x7fac480b44c0 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 -- 172.21.15.55:0/4079299042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 msgr2=0x7fac4809ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 --2- 172.21.15.55:0/4079299042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac4809ba60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fac480cd600 tx=0x7fac3802a140 comp rx=0 tx=0).stop 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 -- 172.21.15.55:0/4079299042 shutdown_connections 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 --2- 172.21.15.55:0/4079299042 >> v2:172.21.15.64:3300/0 conn(0x7fac480ce590 0x7fac480ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 --2- 172.21.15.55:0/4079299042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac4809bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 --2- 172.21.15.55:0/4079299042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac4809ba60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 -- 172.21.15.55:0/4079299042 >> 172.21.15.55:0/4079299042 conn(0x7fac480b4b40 msgr2=0x7fac480b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 -- 172.21.15.55:0/4079299042 shutdown_connections 2024-05-10T03:54:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.850+0000 7fac4df71640 1 -- 172.21.15.55:0/4079299042 wait complete. 2024-05-10T03:54:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.851+0000 7fac4df71640 1 Processor -- start 2024-05-10T03:54:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.851+0000 7fac4df71640 1 -- start start 2024-05-10T03:54:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac4df71640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac48159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac4df71640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac480cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac4df71640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480ce590 0x7fac480d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac4df71640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fac4806e310 con 0x7fac480b44c0 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac4df71640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fac4806e6b0 con 0x7fac480ce590 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac4df71640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fac4806e490 con 0x7fac480b5660 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac48159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac48159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52688/0 (socket says 172.21.15.55:52688) 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 -- 172.21.15.55:0/4161563674 learned_addr learned my addr 172.21.15.55:0/4161563674 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac46ffd640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac480cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac47fff640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480ce590 0x7fac480d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 -- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 msgr2=0x7fac480cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac480cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 -- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480ce590 msgr2=0x7fac480d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480ce590 0x7fac480d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:06.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 -- 172.21.15.55:0/4161563674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac480b72e0 con 0x7fac480b44c0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac46ffd640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac480cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.852+0000 7fac477fe640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac48159c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fac3802a180 tx=0x7fac380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.853+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38041020 con 0x7fac480b44c0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.853+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3803d620 con 0x7fac480b44c0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.853+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac480cb390 con 0x7fac480b44c0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.853+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38037040 con 0x7fac480b44c0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.853+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac480cb950 con 0x7fac480b44c0 2024-05-10T03:54:06.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.854+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4806a7e0 con 0x7fac480b44c0 2024-05-10T03:54:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.854+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac38044020 con 0x7fac480b44c0 2024-05-10T03:54:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.855+0000 7fac2ffff640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fac34076300 0x7fac340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.855+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac380b7b90 con 0x7fac480b44c0 2024-05-10T03:54:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.855+0000 7fac46ffd640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fac34076300 0x7fac340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:06.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.855+0000 7fac46ffd640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fac34076300 0x7fac340787c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac4806ea00 tx=0x7fac3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:06.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:06.859+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac3804b030 con 0x7fac480b44c0 2024-05-10T03:54:07.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.062+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fac480d2dc0 con 0x7fac480b44c0 2024-05-10T03:54:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.062+0000 7fac2ffff640 1 -- 172.21.15.55:0/4161563674 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fac38081580 con 0x7fac480b44c0 2024-05-10T03:54:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fac34076300 msgr2=0x7fac340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fac34076300 0x7fac340787c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac4806ea00 tx=0x7fac3c008040 comp rx=0 tx=0).stop 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 msgr2=0x7fac48159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac48159c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fac3802a180 tx=0x7fac380046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 shutdown_connections 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fac480ce590 0x7fac480d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fac480b5660 0x7fac480cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fac34076300 0x7fac340787c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 --2- 172.21.15.55:0/4161563674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac480b44c0 0x7fac48159c30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 >> 172.21.15.55:0/4161563674 conn(0x7fac480b4b40 msgr2=0x7fac480ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:07.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 shutdown_connections 2024-05-10T03:54:07.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.064+0000 7fac4df71640 1 -- 172.21.15.55:0/4161563674 wait complete. 2024-05-10T03:54:07.078 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-10T03:54:07.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:07.078 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-10T03:54:07.110 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:54:07.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:07.111 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-10T03:54:07.170 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T03:54:07.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:07.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.272+0000 7f35bd215640 1 Processor -- start 2024-05-10T03:54:07.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.272+0000 7f35bd215640 1 -- start start 2024-05-10T03:54:07.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.272+0000 7f35bd215640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f35b815f5e0 0x7f35b80d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.272+0000 7f35bd215640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b80b6250 con 0x7f35b80d5620 2024-05-10T03:54:07.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.272+0000 7f35bd215640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b80b5640 con 0x7f35b80b4ed0 2024-05-10T03:54:07.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.272+0000 7f35bd215640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f35b80d42b0 con 0x7f35b815f5e0 2024-05-10T03:54:07.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b759e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35b80d5620 0x7f35b80d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59146/0 (socket says 172.21.15.55:59146) 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b759e640 1 -- 172.21.15.55:0/1186185401 learned_addr learned my addr 172.21.15.55:0/1186185401 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294465326 0 0) 0x7f35b80b6250 con 0x7f35b80d5620 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a4003520 con 0x7f35b80d5620 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b6d9d640 1 --2- 172.21.15.55:0/1186185401 >> v2:172.21.15.64:3300/0 conn(0x7f35b815f5e0 0x7f35b80d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 395251568 0 0) 0x7f35a4003520 con 0x7f35b80d5620 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 >> v2:172.21.15.64:3300/0 conn(0x7f35b815f5e0 msgr2=0x7f35b80d3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:07.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 --2- 172.21.15.55:0/1186185401 >> v2:172.21.15.64:3300/0 conn(0x7f35b815f5e0 0x7f35b80d3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 >> v1:172.21.15.64:6789/0 conn(0x7f35b80b4ed0 legacy=0x7f35b80d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b80b5920 con 0x7f35b80d5620 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f35b0001a70 con 0x7f35b80d5620 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 >> v1:172.21.15.55:6789/0 conn(0x7f35b80d5620 legacy=0x7f35b80d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4003a50 0x7f35a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4004800 0x7f35a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a40052e0 0x7f35a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80d42b0 con 0x7f35a4004800 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35a400c1b0 con 0x7f35a40052e0 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f35a400c3b0 con 0x7f35a4003a50 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b659c640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4004800 0x7f35a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b759e640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a40052e0 0x7f35a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.273+0000 7f35b6d9d640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4003a50 0x7f35a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b659c640 1 -- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4003a50 msgr2=0x7f35a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b659c640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4003a50 0x7f35a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b659c640 1 -- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a40052e0 msgr2=0x7f35a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b659c640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a40052e0 0x7f35a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b659c640 1 -- 172.21.15.55:0/1186185401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a4003520 con 0x7f35a4004800 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b759e640 1 -- 172.21.15.55:0/1186185401 reap_dead start 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.274+0000 7f35b659c640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4004800 0x7f35a4004c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f35a0001760 tx=0x7f35a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba04b6512eab340f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00013b0 con 0x7f35a4004800 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a00052d0 con 0x7f35a4004800 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35b5d9b640 1 -- 172.21.15.55:0/1186185401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a002aa90 con 0x7f35a4004800 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 -- 172.21.15.55:0/1186185401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4004800 msgr2=0x7f35a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4004800 0x7f35a4004c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f35a0001760 tx=0x7f35a4005830 comp rx=0 tx=0).stop 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 -- 172.21.15.55:0/1186185401 shutdown_connections 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 --2- 172.21.15.55:0/1186185401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4004800 0x7f35a4004c80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 -- 172.21.15.55:0/1186185401 >> 172.21.15.55:0/1186185401 conn(0x7f35b808ec70 msgr2=0x7f35b809e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 -- 172.21.15.55:0/1186185401 shutdown_connections 2024-05-10T03:54:07.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.275+0000 7f35bd215640 1 -- 172.21.15.55:0/1186185401 wait complete. 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 Processor -- start 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 -- start start 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4004800 0x7f35b8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35b8154700 0x7f35b80cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 0x7f35b815fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80b5330 con 0x7f35b8157cd0 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80b5ee0 con 0x7f35b8154700 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.277+0000 7f35bd215640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f35b815f9c0 con 0x7f35a4004800 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 0x7f35b815fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 0x7f35b815fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52706/0 (socket says 172.21.15.55:52706) 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 -- 172.21.15.55:0/1180249438 learned_addr learned my addr 172.21.15.55:0/1180249438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b659c640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35b8154700 0x7f35b80cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b6d9d640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4004800 0x7f35b8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 -- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4004800 msgr2=0x7f35b8154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4004800 0x7f35b8154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 -- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35b8154700 msgr2=0x7f35b80cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35b8154700 0x7f35b80cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 -- 172.21.15.55:0/1180249438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b80ce110 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35b759e640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 0x7f35b815fba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f35b80d5ab0 tx=0x7f35b0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000abb0 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0018070 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00133f0 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b8160a90 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.278+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b80ce3b0 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.280+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b80a3270 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.280+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35b0013590 con 0x7f35b8157cd0 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.281+0000 7f35af7fe640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3598076300 0x7f35980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.281+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35b0097c10 con 0x7f35b8157cd0 2024-05-10T03:54:07.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.281+0000 7f35b6d9d640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3598076300 0x7f35980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.281+0000 7f35b6d9d640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3598076300 0x7f35980787c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f35a8006fd0 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:07.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.285+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f35b0061440 con 0x7f35b8157cd0 2024-05-10T03:54:07.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.514+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35b80cf690 con 0x7f35b8157cd0 2024-05-10T03:54:07.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.514+0000 7f35af7fe640 1 -- 172.21.15.55:0/1180249438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f35b0060d40 con 0x7f35b8157cd0 2024-05-10T03:54:07.517 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:07.518 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:54:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:54:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3598076300 msgr2=0x7f35980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3598076300 0x7f35980787c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f35a8006fd0 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 msgr2=0x7f35b815fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 0x7f35b815fba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f35b80d5ab0 tx=0x7f35b0007a90 comp rx=0 tx=0).stop 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 shutdown_connections 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3598076300 0x7f35980787c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35b8157cd0 0x7f35b815fba0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35b8154700 0x7f35b80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 --2- 172.21.15.55:0/1180249438 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a4004800 0x7f35b8154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.516+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 >> 172.21.15.55:0/1180249438 conn(0x7f35b808ec70 msgr2=0x7f35b806d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.517+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 shutdown_connections 2024-05-10T03:54:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.517+0000 7f35bd215640 1 -- 172.21.15.55:0/1180249438 wait complete. 2024-05-10T03:54:07.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.632+0000 7f267d171640 1 Processor -- start 2024-05-10T03:54:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.632+0000 7f267d171640 1 -- start start 2024-05-10T03:54:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267d171640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f267815b880 0x7f26780b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267d171640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 0x7f26780cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267d171640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2678072cf0 con 0x7f26780cf680 2024-05-10T03:54:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267d171640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2678072fd0 con 0x7f267815b880 2024-05-10T03:54:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267d171640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f26780732b0 con 0x7f2678141c50 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f266ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 0x7f26780cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f2676d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f267815b880 0x7f26780b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267759e640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f26780cf680 0x7f2678073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:41358/0 (socket says 172.21.15.55:41358) 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f266ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 0x7f26780cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:49936/0 (socket says 172.21.15.55:49936) 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.633+0000 7f267759e640 1 -- 172.21.15.55:0/2909373399 learned_addr learned my addr 172.21.15.55:0/2909373399 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.634+0000 7f266ffff640 1 -- 172.21.15.55:0/2909373399 >> v2:172.21.15.64:3300/0 conn(0x7f267815b880 msgr2=0x7f26780b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.634+0000 7f266ffff640 1 --2- 172.21.15.55:0/2909373399 >> v2:172.21.15.64:3300/0 conn(0x7f267815b880 0x7f26780b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.634+0000 7f266ffff640 1 -- 172.21.15.55:0/2909373399 >> v1:172.21.15.64:6789/0 conn(0x7f26780cf680 legacy=0x7f2678073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.634+0000 7f266ffff640 1 -- 172.21.15.55:0/2909373399 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2678073590 con 0x7f2678141c50 2024-05-10T03:54:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.634+0000 7f266ffff640 1 --2- 172.21.15.55:0/2909373399 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 0x7f26780cf140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26600097a0 tx=0x7f266002c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9983bf3ecaf4ee39 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.634+0000 7f267659c640 1 -- 172.21.15.55:0/2909373399 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660039070 con 0x7f2678141c50 2024-05-10T03:54:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267659c640 1 -- 172.21.15.55:0/2909373399 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2660034640 con 0x7f2678141c50 2024-05-10T03:54:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267659c640 1 -- 172.21.15.55:0/2909373399 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660034a10 con 0x7f2678141c50 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 -- 172.21.15.55:0/2909373399 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 msgr2=0x7f26780cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 --2- 172.21.15.55:0/2909373399 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 0x7f26780cf140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26600097a0 tx=0x7f266002c390 comp rx=0 tx=0).stop 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 -- 172.21.15.55:0/2909373399 shutdown_connections 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 --2- 172.21.15.55:0/2909373399 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2678141c50 0x7f26780cf140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 --2- 172.21.15.55:0/2909373399 >> v2:172.21.15.64:3300/0 conn(0x7f267815b880 0x7f26780b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 -- 172.21.15.55:0/2909373399 >> 172.21.15.55:0/2909373399 conn(0x7f26780b2cc0 msgr2=0x7f26780b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 -- 172.21.15.55:0/2909373399 shutdown_connections 2024-05-10T03:54:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.635+0000 7f267d171640 1 -- 172.21.15.55:0/2909373399 wait complete. 2024-05-10T03:54:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.636+0000 7f267d171640 1 Processor -- start 2024-05-10T03:54:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 -- start start 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 0x7f26780b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2678141c50 0x7f26781f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f267815b880 0x7f2678156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2678074340 con 0x7f26780cf680 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f26780741c0 con 0x7f2678141c50 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f267d171640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f26780744c0 con 0x7f267815b880 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f2676d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 0x7f26780b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f2676d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 0x7f26780b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52720/0 (socket says 172.21.15.55:52720) 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.637+0000 7f2676d9d640 1 -- 172.21.15.55:0/4138075164 learned_addr learned my addr 172.21.15.55:0/4138075164 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f266ffff640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2678141c50 0x7f26781f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f267759e640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f267815b880 0x7f2678156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f2676d9d640 1 -- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f267815b880 msgr2=0x7f2678156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f2676d9d640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f267815b880 0x7f2678156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f2676d9d640 1 -- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2678141c50 msgr2=0x7f26781f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f2676d9d640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2678141c50 0x7f26781f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f2676d9d640 1 -- 172.21.15.55:0/4138075164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781f2800 con 0x7f26780cf680 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f266ffff640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2678141c50 0x7f26781f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f267759e640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f267815b880 0x7f2678156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f2676d9d640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 0x7f26780b1b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f266800e870 tx=0x7f266800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668017070 con 0x7f26780cf680 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26780aa950 con 0x7f26780cf680 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266800c940 con 0x7f26780cf680 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266800cd30 con 0x7f26780cf680 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.638+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26780aaf10 con 0x7f26780cf680 2024-05-10T03:54:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.639+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678050820 con 0x7f26780cf680 2024-05-10T03:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.640+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f266801a070 con 0x7f26780cf680 2024-05-10T03:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.640+0000 7f266f7fe640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f26580762d0 0x7f2658078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.640+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2668097510 con 0x7f26780cf680 2024-05-10T03:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.641+0000 7f266ffff640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f26580762d0 0x7f2658078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.641+0000 7f266ffff640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f26580762d0 0x7f2658078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f2660030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.645+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2668060df0 con 0x7f26780cf680 2024-05-10T03:54:07.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.880+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26780755c0 con 0x7f26780cf680 2024-05-10T03:54:07.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.880+0000 7f266f7fe640 1 -- 172.21.15.55:0/4138075164 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f26680606f0 con 0x7f26780cf680 2024-05-10T03:54:07.883 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:07.883 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:54:07.883 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:54:07.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.882+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f26580762d0 msgr2=0x7f2658078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.882+0000 7f267d171640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f26580762d0 0x7f2658078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f2660030000 comp rx=0 tx=0).stop 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.882+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 msgr2=0x7f26780b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.882+0000 7f267d171640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 0x7f26780b1b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f266800e870 tx=0x7f266800ed30 comp rx=0 tx=0).stop 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 shutdown_connections 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f267815b880 0x7f2678156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2678141c50 0x7f26781f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f26580762d0 0x7f2658078790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 --2- 172.21.15.55:0/4138075164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26780cf680 0x7f26780b1b20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 >> 172.21.15.55:0/4138075164 conn(0x7f26780b2cc0 msgr2=0x7f267815f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 shutdown_connections 2024-05-10T03:54:07.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.883+0000 7f267d171640 1 -- 172.21.15.55:0/4138075164 wait complete. 2024-05-10T03:54:07.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.997+0000 7f6818ff0640 1 Processor -- start 2024-05-10T03:54:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.997+0000 7f6818ff0640 1 -- start start 2024-05-10T03:54:08.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f6818ff0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6814162aa0 0x7f68140d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f6818ff0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f68140d3690 0x7f68140bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f6818ff0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68140d3b90 con 0x7f68140d1d40 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f6818ff0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f68140d5170 con 0x7f6814162aa0 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f6818ff0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f68140d3e70 con 0x7f68140d3690 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f681259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6814162aa0 0x7f68140d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f681259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6814162aa0 0x7f68140d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52726/0 (socket says 172.21.15.55:52726) 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.998+0000 7f681259c640 1 -- 172.21.15.55:0/2747842879 learned_addr learned my addr 172.21.15.55:0/2747842879 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.999+0000 7f6811d9b640 1 --2- 172.21.15.55:0/2747842879 >> v2:172.21.15.64:3300/0 conn(0x7f68140d3690 0x7f68140bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.999+0000 7f681259c640 1 -- 172.21.15.55:0/2747842879 >> v2:172.21.15.64:3300/0 conn(0x7f68140d3690 msgr2=0x7f68140bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.999+0000 7f681259c640 1 --2- 172.21.15.55:0/2747842879 >> v2:172.21.15.64:3300/0 conn(0x7f68140d3690 0x7f68140bac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.999+0000 7f681259c640 1 -- 172.21.15.55:0/2747842879 >> v1:172.21.15.55:6789/0 conn(0x7f68140d1d40 legacy=0x7f68140b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:07.999+0000 7f681259c640 1 -- 172.21.15.55:0/2747842879 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68140d4150 con 0x7f6814162aa0 2024-05-10T03:54:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f681259c640 1 --2- 172.21.15.55:0/2747842879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f68140d4c30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6814069ce0 tx=0x7f680402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b36be3461293cd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f681159a640 1 -- 172.21.15.55:0/2747842879 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804036070 con 0x7f6814162aa0 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f681159a640 1 -- 172.21.15.55:0/2747842879 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6804031600 con 0x7f6814162aa0 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f681159a640 1 -- 172.21.15.55:0/2747842879 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68040319d0 con 0x7f6814162aa0 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 -- 172.21.15.55:0/2747842879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 msgr2=0x7f68140d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2747842879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f68140d4c30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6814069ce0 tx=0x7f680402a730 comp rx=0 tx=0).stop 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 -- 172.21.15.55:0/2747842879 shutdown_connections 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2747842879 >> v2:172.21.15.64:3300/0 conn(0x7f68140d3690 0x7f68140bac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2747842879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f68140d4c30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 -- 172.21.15.55:0/2747842879 >> 172.21.15.55:0/2747842879 conn(0x7f68140740f0 msgr2=0x7f681406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 -- 172.21.15.55:0/2747842879 shutdown_connections 2024-05-10T03:54:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.000+0000 7f6818ff0640 1 -- 172.21.15.55:0/2747842879 wait complete. 2024-05-10T03:54:08.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.002+0000 7f6818ff0640 1 Processor -- start 2024-05-10T03:54:08.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.002+0000 7f6818ff0640 1 -- start start 2024-05-10T03:54:08.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68140d1d40 0x7f6814159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68140d3690 0x7f68141f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f6814148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f68140bb190 con 0x7f6814162aa0 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f68140d4710 con 0x7f68140d1d40 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f68140d21d0 con 0x7f68140d3690 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f6814148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f6814148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52728/0 (socket says 172.21.15.55:52728) 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 -- 172.21.15.55:0/2994646137 learned_addr learned my addr 172.21.15.55:0/2994646137 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f681259c640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68140d1d40 0x7f6814159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6811d9b640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68140d3690 0x7f68141f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 -- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68140d3690 msgr2=0x7f68141f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68140d3690 0x7f68141f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 -- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68140d1d40 msgr2=0x7f6814159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68140d1d40 0x7f6814159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 -- 172.21.15.55:0/2994646137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68141f5450 con 0x7f6814162aa0 2024-05-10T03:54:08.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6812d9d640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f6814148880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f680c00c400 tx=0x7f680c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c017070 con 0x7f6814162aa0 2024-05-10T03:54:08.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c0052d0 con 0x7f6814162aa0 2024-05-10T03:54:08.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c0037f0 con 0x7f6814162aa0 2024-05-10T03:54:08.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.003+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68141f5730 con 0x7f6814162aa0 2024-05-10T03:54:08.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.004+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68141f5cf0 con 0x7f6814162aa0 2024-05-10T03:54:08.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.004+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681406e7a0 con 0x7f6814162aa0 2024-05-10T03:54:08.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.005+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f680c01a070 con 0x7f6814162aa0 2024-05-10T03:54:08.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.005+0000 7f680affd640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67f40762d0 0x7f67f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.006+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f680c0967c0 con 0x7f6814162aa0 2024-05-10T03:54:08.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.006+0000 7f681259c640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67f40762d0 0x7f67f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.006+0000 7f681259c640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67f40762d0 0x7f67f4078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6804033000 tx=0x7f6804009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.010+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f680c05fb60 con 0x7f6814162aa0 2024-05-10T03:54:08.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.200+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6814159c50 con 0x7f6814162aa0 2024-05-10T03:54:08.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.201+0000 7f680affd640 1 -- 172.21.15.55:0/2994646137 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7f680c0681a0 con 0x7f6814162aa0 2024-05-10T03:54:08.204 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:08.205 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67f40762d0 msgr2=0x7f67f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67f40762d0 0x7f67f4078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6804033000 tx=0x7f6804009000 comp rx=0 tx=0).stop 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 msgr2=0x7f6814148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f6814148880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f680c00c400 tx=0x7f680c00c8c0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 shutdown_connections 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f67f40762d0 0x7f67f4078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6814162aa0 0x7f6814148880 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68140d3690 0x7f68141f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 --2- 172.21.15.55:0/2994646137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68140d1d40 0x7f6814159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 >> 172.21.15.55:0/2994646137 conn(0x7f68140740f0 msgr2=0x7f68140ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 shutdown_connections 2024-05-10T03:54:08.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.204+0000 7f6818ff0640 1 -- 172.21.15.55:0/2994646137 wait complete. 2024-05-10T03:54:08.218 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T03:54:08.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.319+0000 7f33a7a20640 1 Processor -- start 2024-05-10T03:54:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.319+0000 7f33a7a20640 1 -- start start 2024-05-10T03:54:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a7a20640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a015d0b0 0x7f33a015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a7a20640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a00ce830 0x7f33a00d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a7a20640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a00d0040 con 0x7f33a006c390 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a7a20640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f33a015e5e0 con 0x7f33a015d0b0 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a7a20640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f33a0142e00 con 0x7f33a00ce830 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a57bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a015d0b0 0x7f33a015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a57bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a015d0b0 0x7f33a015e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52734/0 (socket says 172.21.15.55:52734) 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a57bc640 1 -- 172.21.15.55:0/3323983072 learned_addr learned my addr 172.21.15.55:0/3323983072 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.320+0000 7f33a5fbd640 1 --2- 172.21.15.55:0/3323983072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a00ce830 0x7f33a00d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.321+0000 7f33a57bc640 1 -- 172.21.15.55:0/3323983072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a00ce830 msgr2=0x7f33a00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.321+0000 7f33a57bc640 1 --2- 172.21.15.55:0/3323983072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a00ce830 0x7f33a00d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.321+0000 7f33a57bc640 1 -- 172.21.15.55:0/3323983072 >> v1:172.21.15.64:6789/0 conn(0x7f33a006c390 legacy=0x7f33a00ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.321+0000 7f33a57bc640 1 -- 172.21.15.55:0/3323983072 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a01430e0 con 0x7f33a015d0b0 2024-05-10T03:54:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.321+0000 7f33a57bc640 1 --2- 172.21.15.55:0/3323983072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a015e0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f339c009870 tx=0x7f339c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f2ee8e92516b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f3397fff640 1 -- 172.21.15.55:0/3323983072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c037070 con 0x7f33a015d0b0 2024-05-10T03:54:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f3397fff640 1 -- 172.21.15.55:0/3323983072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c032440 con 0x7f33a015d0b0 2024-05-10T03:54:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f3397fff640 1 -- 172.21.15.55:0/3323983072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c032810 con 0x7f33a015d0b0 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 -- 172.21.15.55:0/3323983072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 msgr2=0x7f33a015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 --2- 172.21.15.55:0/3323983072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a015e0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f339c009870 tx=0x7f339c02a270 comp rx=0 tx=0).stop 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 -- 172.21.15.55:0/3323983072 shutdown_connections 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 --2- 172.21.15.55:0/3323983072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a00ce830 0x7f33a00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 --2- 172.21.15.55:0/3323983072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a015e0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 -- 172.21.15.55:0/3323983072 >> 172.21.15.55:0/3323983072 conn(0x7f33a00d16d0 msgr2=0x7f33a00d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 -- 172.21.15.55:0/3323983072 shutdown_connections 2024-05-10T03:54:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.322+0000 7f33a7a20640 1 -- 172.21.15.55:0/3323983072 wait complete. 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.323+0000 7f33a7a20640 1 Processor -- start 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.323+0000 7f33a7a20640 1 -- start start 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a7a20640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a006c390 0x7f33a0132820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a7a20640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a00ce830 0x7f33a01f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a7a20640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a7a20640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f33a015d490 con 0x7f33a015d0b0 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a7a20640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01436a0 con 0x7f33a00ce830 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a7a20640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00cdc10 con 0x7f33a006c390 2024-05-10T03:54:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a5fbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a5fbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a0156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52736/0 (socket says 172.21.15.55:52736) 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a5fbd640 1 -- 172.21.15.55:0/1097196261 learned_addr learned my addr 172.21.15.55:0/1097196261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a4fbb640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a00ce830 0x7f33a01f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.324+0000 7f33a57bc640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a006c390 0x7f33a0132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a5fbd640 1 -- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a006c390 msgr2=0x7f33a0132820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a5fbd640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a006c390 0x7f33a0132820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a5fbd640 1 -- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a00ce830 msgr2=0x7f33a01f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a5fbd640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a00ce830 0x7f33a01f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a5fbd640 1 -- 172.21.15.55:0/1097196261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a0159c30 con 0x7f33a015d0b0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a5fbd640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a0156b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f339800efc0 tx=0x7f339800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398018020 con 0x7f33a015d0b0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3398014480 con 0x7f33a015d0b0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a015a220 con 0x7f33a015d0b0 2024-05-10T03:54:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398014870 con 0x7f33a015d0b0 2024-05-10T03:54:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.325+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a015a7e0 con 0x7f33a015d0b0 2024-05-10T03:54:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.326+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a015a9e0 con 0x7f33a015d0b0 2024-05-10T03:54:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.327+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3398005d10 con 0x7f33a015d0b0 2024-05-10T03:54:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.327+0000 7f3395ffb640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f33840762d0 0x7f3384078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.328+0000 7f33a57bc640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f33840762d0 0x7f3384078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.328+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3398097fe0 con 0x7f33a015d0b0 2024-05-10T03:54:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.328+0000 7f33a57bc640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f33840762d0 0x7f3384078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f339c034000 tx=0x7f339c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.332+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f33a015a9e0 con 0x7f33a015d0b0 2024-05-10T03:54:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.570+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33a0050820 con 0x7f33a015d0b0 2024-05-10T03:54:08.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.571+0000 7f3395ffb640 1 -- 172.21.15.55:0/1097196261 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f3398022070 con 0x7f33a015d0b0 2024-05-10T03:54:08.574 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:08.574 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:54:08.574 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f33840762d0 msgr2=0x7f3384078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f33840762d0 0x7f3384078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f339c034000 tx=0x7f339c02e000 comp rx=0 tx=0).stop 2024-05-10T03:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 msgr2=0x7f33a0156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a0156b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f339800efc0 tx=0x7f339800c490 comp rx=0 tx=0).stop 2024-05-10T03:54:08.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 shutdown_connections 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f33840762d0 0x7f3384078790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a015d0b0 0x7f33a0156b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33a00ce830 0x7f33a01f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 --2- 172.21.15.55:0/1097196261 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33a006c390 0x7f33a0132820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 >> 172.21.15.55:0/1097196261 conn(0x7f33a00d16d0 msgr2=0x7f33a0142340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 shutdown_connections 2024-05-10T03:54:08.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.573+0000 7f33a7a20640 1 -- 172.21.15.55:0/1097196261 wait complete. 2024-05-10T03:54:08.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.688+0000 7f35aba1d640 1 Processor -- start 2024-05-10T03:54:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 -- start start 2024-05-10T03:54:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f35a40d3ad0 0x7f35a40d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35a4162f80 0x7f35a40d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d2fd0 0x7f35a406eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f35a4163410 con 0x7f35a4162f80 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f35a41636f0 con 0x7f35a40d3ad0 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.689+0000 7f35aba1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f35a41639d0 con 0x7f35a40d2fd0 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35a4162f80 0x7f35a40d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35a4162f80 0x7f35a40d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52752/0 (socket says 172.21.15.55:52752) 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 -- 172.21.15.55:0/4025282906 learned_addr learned my addr 172.21.15.55:0/4025282906 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 -- 172.21.15.55:0/4025282906 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d2fd0 msgr2=0x7f35a406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/4025282906 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d2fd0 0x7f35a406eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 -- 172.21.15.55:0/4025282906 >> v2:172.21.15.64:3300/0 conn(0x7f35a40d3ad0 msgr2=0x7f35a40d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/4025282906 >> v2:172.21.15.64:3300/0 conn(0x7f35a40d3ad0 0x7f35a40d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.690+0000 7f35a8fb8640 1 -- 172.21.15.55:0/4025282906 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a4163cb0 con 0x7f35a4162f80 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/4025282906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4162f80 0x7f35a40d0e90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35a4163900 tx=0x7f359402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cdca3111f43ea0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f359bfff640 1 -- 172.21.15.55:0/4025282906 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594037070 con 0x7f35a4162f80 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f359bfff640 1 -- 172.21.15.55:0/4025282906 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3594032440 con 0x7f35a4162f80 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f359bfff640 1 -- 172.21.15.55:0/4025282906 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594032810 con 0x7f35a4162f80 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 -- 172.21.15.55:0/4025282906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4162f80 msgr2=0x7f35a40d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 --2- 172.21.15.55:0/4025282906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4162f80 0x7f35a40d0e90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f35a4163900 tx=0x7f359402a130 comp rx=0 tx=0).stop 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 -- 172.21.15.55:0/4025282906 shutdown_connections 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 --2- 172.21.15.55:0/4025282906 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d2fd0 0x7f35a406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 --2- 172.21.15.55:0/4025282906 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a4162f80 0x7f35a40d0e90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 --2- 172.21.15.55:0/4025282906 >> v2:172.21.15.64:3300/0 conn(0x7f35a40d3ad0 0x7f35a40d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 -- 172.21.15.55:0/4025282906 >> 172.21.15.55:0/4025282906 conn(0x7f35a4071f80 msgr2=0x7f35a4072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 -- 172.21.15.55:0/4025282906 shutdown_connections 2024-05-10T03:54:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.691+0000 7f35aba1d640 1 -- 172.21.15.55:0/4025282906 wait complete. 2024-05-10T03:54:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 Processor -- start 2024-05-10T03:54:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 -- start start 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 0x7f35a4147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d3ad0 0x7f35a414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a415bf30 0x7f35a40b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f35a40d13d0 con 0x7f35a40d2fd0 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35a40d3eb0 con 0x7f35a415bf30 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35aba1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f35a40d1550 con 0x7f35a40d3ad0 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35a97b9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 0x7f35a4147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35a97b9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 0x7f35a4147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52764/0 (socket says 172.21.15.55:52764) 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.693+0000 7f35a97b9640 1 -- 172.21.15.55:0/3871120828 learned_addr learned my addr 172.21.15.55:0/3871120828 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d3ad0 0x7f35a414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a9fba640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a415bf30 0x7f35a40b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a97b9640 1 -- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d3ad0 msgr2=0x7f35a414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a97b9640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d3ad0 0x7f35a414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a97b9640 1 -- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a415bf30 msgr2=0x7f35a40b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a97b9640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a415bf30 0x7f35a40b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a97b9640 1 -- 172.21.15.55:0/3871120828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a414b520 con 0x7f35a40d2fd0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d3ad0 0x7f35a414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a9fba640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a415bf30 0x7f35a40b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35a97b9640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 0x7f35a4147ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35a000b4a0 tx=0x7f35a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0014070 con 0x7f35a40d2fd0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a0010610 con 0x7f35a40d2fd0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a415c3d0 con 0x7f35a40d2fd0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0010a00 con 0x7f35a40d2fd0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.694+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a415c990 con 0x7f35a40d2fd0 2024-05-10T03:54:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.695+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a4071ac0 con 0x7f35a40d2fd0 2024-05-10T03:54:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.696+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35a0017070 con 0x7f35a40d2fd0 2024-05-10T03:54:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.696+0000 7f3599ffb640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35880762d0 0x7f3588078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.696+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35a0096f70 con 0x7f35a40d2fd0 2024-05-10T03:54:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.696+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35880762d0 0x7f3588078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.697+0000 7f35a8fb8640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35880762d0 0x7f3588078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3594034000 tx=0x7f359402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:08.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.701+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f35a414b520 con 0x7f35a40d2fd0 2024-05-10T03:54:08.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.931+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35a4050820 con 0x7f35a40d2fd0 2024-05-10T03:54:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.931+0000 7f3599ffb640 1 -- 172.21.15.55:0/3871120828 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f35a0060960 con 0x7f35a40d2fd0 2024-05-10T03:54:08.934 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:08.934 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/3613180178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":3613180178},{"type":"v1","addr":"172.21.15.64:6834","nonce":3613180178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/2284782853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2284782853},{"type":"v1","addr":"172.21.15.55:6836","nonce":2284782853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/1339512524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":1339512524},{"type":"v1","addr":"172.21.15.55:6837","nonce":1339512524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:53:37.640203+0000","modified":"2024-05-10T03:53:40.655297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6835/1222315880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":1222315880},{"type":"v1","addr":"172.21.15.64:6835","nonce":1222315880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-05-10T03:54:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35880762d0 msgr2=0x7f3588078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35880762d0 0x7f3588078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3594034000 tx=0x7f359402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 msgr2=0x7f35a4147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 0x7f35a4147ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35a000b4a0 tx=0x7f35a000b960 comp rx=0 tx=0).stop 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 shutdown_connections 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a415bf30 0x7f35a40b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35a40d3ad0 0x7f35a414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f35880762d0 0x7f3588078790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 --2- 172.21.15.55:0/3871120828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35a40d2fd0 0x7f35a4147ea0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 >> 172.21.15.55:0/3871120828 conn(0x7f35a4071f80 msgr2=0x7f35a41594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 shutdown_connections 2024-05-10T03:54:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:08.934+0000 7f35aba1d640 1 -- 172.21.15.55:0/3871120828 wait complete. 2024-05-10T03:54:08.947 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:09.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.049+0000 7f9917b51640 1 Processor -- start 2024-05-10T03:54:09.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.049+0000 7f9917b51640 1 -- start start 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f9917b51640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f99100d3690 0x7f99100d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f9917b51640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99100d1d40 0x7f99100d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f9917b51640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99100d3b90 con 0x7f9910162aa0 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f9917b51640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f99100d5170 con 0x7f99100d1d40 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f9917b51640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f99100d3e70 con 0x7f99100d3690 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99100d1d40 0x7f99100d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99100d1d40 0x7f99100d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52774/0 (socket says 172.21.15.55:52774) 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 -- 172.21.15.55:0/4286487138 learned_addr learned my addr 172.21.15.55:0/4286487138 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99150ec640 1 --2- 172.21.15.55:0/4286487138 >> v2:172.21.15.64:3300/0 conn(0x7f99100d3690 0x7f99100d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 -- 172.21.15.55:0/4286487138 >> v2:172.21.15.64:3300/0 conn(0x7f99100d3690 msgr2=0x7f99100d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 --2- 172.21.15.55:0/4286487138 >> v2:172.21.15.64:3300/0 conn(0x7f99100d3690 0x7f99100d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 -- 172.21.15.55:0/4286487138 >> v1:172.21.15.64:6789/0 conn(0x7f9910162aa0 legacy=0x7f99100bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.050+0000 7f99160ee640 1 -- 172.21.15.55:0/4286487138 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99100d4150 con 0x7f99100d1d40 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.051+0000 7f99160ee640 1 --2- 172.21.15.55:0/4286487138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99100d1d40 0x7f99100d21d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9910069ce0 tx=0x7f990802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148f79c35ccaa10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.051+0000 7f99148eb640 1 -- 172.21.15.55:0/4286487138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908037070 con 0x7f99100d1d40 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.051+0000 7f99148eb640 1 -- 172.21.15.55:0/4286487138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9908032440 con 0x7f99100d1d40 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.051+0000 7f99148eb640 1 -- 172.21.15.55:0/4286487138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908032810 con 0x7f99100d1d40 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.051+0000 7f9917b51640 1 -- 172.21.15.55:0/4286487138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99100d1d40 msgr2=0x7f99100d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 --2- 172.21.15.55:0/4286487138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99100d1d40 0x7f99100d21d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9910069ce0 tx=0x7f990802a1e0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 -- 172.21.15.55:0/4286487138 shutdown_connections 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 --2- 172.21.15.55:0/4286487138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99100d1d40 0x7f99100d21d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 --2- 172.21.15.55:0/4286487138 >> v2:172.21.15.64:3300/0 conn(0x7f99100d3690 0x7f99100d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 -- 172.21.15.55:0/4286487138 >> 172.21.15.55:0/4286487138 conn(0x7f99100740f0 msgr2=0x7f991006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 -- 172.21.15.55:0/4286487138 shutdown_connections 2024-05-10T03:54:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.052+0000 7f9917b51640 1 -- 172.21.15.55:0/4286487138 wait complete. 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.053+0000 7f9917b51640 1 Processor -- start 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.053+0000 7f9917b51640 1 -- start start 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f9917b51640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99100d1d40 0x7f9910153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f9917b51640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f99100d3690 0x7f991015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f9917b51640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 0x7f99100ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f9917b51640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f99100b8460 con 0x7f9910162aa0 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f9917b51640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f99100d4710 con 0x7f99100d1d40 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f9917b51640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f99100b85e0 con 0x7f99100d3690 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 0x7f99100ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 0x7f99100ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52788/0 (socket says 172.21.15.55:52788) 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 -- 172.21.15.55:0/2557180515 learned_addr learned my addr 172.21.15.55:0/2557180515 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99150ec640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f99100d3690 0x7f991015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99158ed640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99100d1d40 0x7f9910153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 -- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f99100d3690 msgr2=0x7f991015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f99100d3690 0x7f991015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 -- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99100d1d40 msgr2=0x7f9910153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99100d1d40 0x7f9910153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 -- 172.21.15.55:0/2557180515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991015ba00 con 0x7f9910162aa0 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99150ec640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f99100d3690 0x7f991015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99158ed640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99100d1d40 0x7f9910153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.054+0000 7f99160ee640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 0x7f99100ca5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99080090b0 tx=0x7f99080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.055+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908041070 con 0x7f9910162aa0 2024-05-10T03:54:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.055+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990803c950 con 0x7f9910162aa0 2024-05-10T03:54:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.055+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991015bce0 con 0x7f9910162aa0 2024-05-10T03:54:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.055+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908037040 con 0x7f9910162aa0 2024-05-10T03:54:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.055+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9910157e80 con 0x7f9910162aa0 2024-05-10T03:54:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.056+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991006e7a0 con 0x7f9910162aa0 2024-05-10T03:54:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.056+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9908044070 con 0x7f9910162aa0 2024-05-10T03:54:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.057+0000 7f990e7fc640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98fc0762d0 0x7f98fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.057+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f99080b8270 con 0x7f9910162aa0 2024-05-10T03:54:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.057+0000 7f99158ed640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98fc0762d0 0x7f98fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.057+0000 7f99158ed640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98fc0762d0 0x7f98fc078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9900009fc0 tx=0x7f9900009550 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.061+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9908081b30 con 0x7f9910162aa0 2024-05-10T03:54:09.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.252+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9910050820 con 0x7f9910162aa0 2024-05-10T03:54:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.253+0000 7f990e7fc640 1 -- 172.21.15.55:0/2557180515 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16509 (secure 0 0 0) 0x7f9908081430 con 0x7f9910162aa0 2024-05-10T03:54:09.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:09.256 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:53:39.259624+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:53:35.315747+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T03:53:36.586927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98fc0762d0 msgr2=0x7f98fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98fc0762d0 0x7f98fc078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9900009fc0 tx=0x7f9900009550 comp rx=0 tx=0).stop 2024-05-10T03:54:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 msgr2=0x7f99100ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 0x7f99100ca5f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99080090b0 tx=0x7f99080046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 shutdown_connections 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98fc0762d0 0x7f98fc078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9910162aa0 0x7f99100ca5f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f99100d3690 0x7f991015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 --2- 172.21.15.55:0/2557180515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f99100d1d40 0x7f9910153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 >> 172.21.15.55:0/2557180515 conn(0x7f99100740f0 msgr2=0x7f9910153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 shutdown_connections 2024-05-10T03:54:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.255+0000 7f9917b51640 1 -- 172.21.15.55:0/2557180515 wait complete. 2024-05-10T03:54:09.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T03:54:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.372+0000 7fd4d0f46640 1 Processor -- start 2024-05-10T03:54:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.372+0000 7fd4d0f46640 1 -- start start 2024-05-10T03:54:09.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4d0f46640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4cc09c170 0x7fd4cc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4d0f46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b5660 0x7fd4cc0d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4d0f46640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4cc0cd7d0 con 0x7fd4cc0b44c0 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4d0f46640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fd4cc0b48a0 con 0x7fd4cc09c170 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4d0f46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd4cc0cdab0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4cc09c170 0x7fd4cc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4cc09c170 0x7fd4cc0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52794/0 (socket says 172.21.15.55:52794) 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 -- 172.21.15.55:0/480913008 learned_addr learned my addr 172.21.15.55:0/480913008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4cad9d640 1 --2- 172.21.15.55:0/480913008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b5660 0x7fd4cc0d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 -- 172.21.15.55:0/480913008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b5660 msgr2=0x7fd4cc0d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 --2- 172.21.15.55:0/480913008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b5660 0x7fd4cc0d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 -- 172.21.15.55:0/480913008 >> v1:172.21.15.55:6789/0 conn(0x7fd4cc0b44c0 legacy=0x7fd4cc09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.373+0000 7fd4c9d9b640 1 -- 172.21.15.55:0/480913008 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc0cdd90 con 0x7fd4cc09c170 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.374+0000 7fd4c9d9b640 1 --2- 172.21.15.55:0/480913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc09c170 0x7fd4cc0d1170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009870 tx=0x7fd4c002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f5b19abeeaf0f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.374+0000 7fd4c959a640 1 -- 172.21.15.55:0/480913008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0037070 con 0x7fd4cc09c170 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.374+0000 7fd4c959a640 1 -- 172.21.15.55:0/480913008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c0032440 con 0x7fd4cc09c170 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.374+0000 7fd4c959a640 1 -- 172.21.15.55:0/480913008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0032810 con 0x7fd4cc09c170 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 -- 172.21.15.55:0/480913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc09c170 msgr2=0x7fd4cc0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/480913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc09c170 0x7fd4cc0d1170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009870 tx=0x7fd4c002a1c0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 -- 172.21.15.55:0/480913008 shutdown_connections 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/480913008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b5660 0x7fd4cc0d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/480913008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc09c170 0x7fd4cc0d1170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 -- 172.21.15.55:0/480913008 >> 172.21.15.55:0/480913008 conn(0x7fd4cc0b4b40 msgr2=0x7fd4cc0b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 -- 172.21.15.55:0/480913008 shutdown_connections 2024-05-10T03:54:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.375+0000 7fd4d0f46640 1 -- 172.21.15.55:0/480913008 wait complete. 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.376+0000 7fd4d0f46640 1 Processor -- start 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 -- start start 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4cc09c170 0x7fd4cc152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b44c0 0x7fd4cc0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 0x7fd4cc0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc06e310 con 0x7fd4cc0b5660 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc06e6b0 con 0x7fd4cc09c170 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4d0f46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd4cc06e490 con 0x7fd4cc0b44c0 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4cad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 0x7fd4cc0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4cad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 0x7fd4cc0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52806/0 (socket says 172.21.15.55:52806) 2024-05-10T03:54:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4cad9d640 1 -- 172.21.15.55:0/3868840763 learned_addr learned my addr 172.21.15.55:0/3868840763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4ca59c640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4cc09c170 0x7fd4cc152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.377+0000 7fd4c9d9b640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b44c0 0x7fd4cc0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4cad9d640 1 -- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b44c0 msgr2=0x7fd4cc0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4cad9d640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b44c0 0x7fd4cc0ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4cad9d640 1 -- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4cc09c170 msgr2=0x7fd4cc152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4cad9d640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4cc09c170 0x7fd4cc152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4cad9d640 1 -- 172.21.15.55:0/3868840763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc0b5be0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4cad9d640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 0x7fd4cc0c8d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007e40 tx=0x7fd4c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4014620 con 0x7fd4cc0b5660 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c4019070 con 0x7fd4cc0b5660 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4cc0b5ec0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4014a20 con 0x7fd4cc0b5660 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.378+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4cc1529b0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.379+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4cc06a7e0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.380+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd4c4014bc0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.380+0000 7fd4baffd640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd4ac0762d0 0x7fd4ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.380+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd4c4097d20 con 0x7fd4cc0b5660 2024-05-10T03:54:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.380+0000 7fd4ca59c640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd4ac0762d0 0x7fd4ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.381+0000 7fd4ca59c640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd4ac0762d0 0x7fd4ac078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0017c0 tx=0x7fd4bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.384+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd4c40610c0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.612+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd4cc0b3940 con 0x7fd4cc0b5660 2024-05-10T03:54:09.615 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-05-10T03:54:09.613+0000 7f4000d9b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T03:54:09.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.616+0000 7fd4baffd640 1 -- 172.21.15.55:0/3868840763 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fd4c40653c0 con 0x7fd4cc0b5660 2024-05-10T03:54:09.618 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd4ac0762d0 msgr2=0x7fd4ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd4ac0762d0 0x7fd4ac078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0017c0 tx=0x7fd4bc009040 comp rx=0 tx=0).stop 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 msgr2=0x7fd4cc0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 0x7fd4cc0c8d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007e40 tx=0x7fd4c400e4b0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 shutdown_connections 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd4ac0762d0 0x7fd4ac078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4cc0b5660 0x7fd4cc0c8d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd4cc0b44c0 0x7fd4cc0ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 --2- 172.21.15.55:0/3868840763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd4cc09c170 0x7fd4cc152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 >> 172.21.15.55:0/3868840763 conn(0x7fd4cc0b4b40 msgr2=0x7fd4cc0d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 shutdown_connections 2024-05-10T03:54:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.618+0000 7fd4d0f46640 1 -- 172.21.15.55:0/3868840763 wait complete. 2024-05-10T03:54:09.623 INFO:tasks.ceph.mds.b.smithi064.stderr: -7978> 2024-05-10T03:53:32.021+0000 7f02166cd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-10T03:54:09.626 INFO:tasks.ceph.mds.b.smithi064.stderr: -6684> 2024-05-10T03:53:43.021+0000 7f02106c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T03:54:09.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T03:54:09.661 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2024-05-10T03:54:09.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.736+0000 7f8c2939d640 1 Processor -- start 2024-05-10T03:54:09.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.736+0000 7f8c2939d640 1 -- start start 2024-05-10T03:54:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c2939d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 0x7f8c24070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c2939d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c24071750 con 0x7f8c241484e0 2024-05-10T03:54:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c2939d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c24071a30 con 0x7f8c24070f40 2024-05-10T03:54:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c2939d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8c240afbd0 con 0x7f8c2406caa0 2024-05-10T03:54:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c22ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c241484e0 0x7f8c2406c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59178/0 (socket says 172.21.15.55:59178) 2024-05-10T03:54:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c22ffd640 1 -- 172.21.15.55:0/2867812075 learned_addr learned my addr 172.21.15.55:0/2867812075 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c1a7fc640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 0x7f8c24070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707867132 0 0) 0x7f8c24071750 con 0x7f8c241484e0 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c10003520 con 0x7f8c241484e0 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398268682 0 0) 0x7f8c10003520 con 0x7f8c241484e0 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 msgr2=0x7f8c24070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 0x7f8c24070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 >> v1:172.21.15.64:6789/0 conn(0x7f8c24070f40 legacy=0x7f8c240b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c24071d10 con 0x7f8c241484e0 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f8c140016f0 con 0x7f8c241484e0 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 >> v1:172.21.15.55:6789/0 conn(0x7f8c241484e0 legacy=0x7f8c2406c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.737+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 0x7f8c100039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c10003f70 0x7f8c10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8c240afbd0 con 0x7f8c10004d40 2024-05-10T03:54:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1000bad0 con 0x7f8c10003f70 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1000bcd0 con 0x7f8c2406caa0 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c237fe640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c1a7fc640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c10003f70 0x7f8c10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 0x7f8c100039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c237fe640 1 -- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 msgr2=0x7f8c100039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c237fe640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c2406caa0 0x7f8c100039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c237fe640 1 -- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c10003f70 msgr2=0x7f8c10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c237fe640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c10003f70 0x7f8c10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.738+0000 7f8c237fe640 1 -- 172.21.15.55:0/2867812075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c10003520 con 0x7f8c10004d40 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c237fe640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c100051c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c001ee0 tx=0x7f8c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694381ee79024ea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c037070 con 0x7f8c10004d40 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c032440 con 0x7f8c10004d40 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c227fc640 1 -- 172.21.15.55:0/2867812075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c001b30 con 0x7f8c10004d40 2024-05-10T03:54:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c2939d640 1 -- 172.21.15.55:0/2867812075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 msgr2=0x7f8c100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c2939d640 1 --2- 172.21.15.55:0/2867812075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c100051c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c001ee0 tx=0x7f8c10005830 comp rx=0 tx=0).stop 2024-05-10T03:54:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c237fe640 1 -- 172.21.15.55:0/2867812075 reap_dead start 2024-05-10T03:54:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c2939d640 1 -- 172.21.15.55:0/2867812075 shutdown_connections 2024-05-10T03:54:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c2939d640 1 -- 172.21.15.55:0/2867812075 >> 172.21.15.55:0/2867812075 conn(0x7f8c2406de10 msgr2=0x7f8c240b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c2939d640 1 -- 172.21.15.55:0/2867812075 shutdown_connections 2024-05-10T03:54:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.739+0000 7f8c2939d640 1 -- 172.21.15.55:0/2867812075 wait complete. 2024-05-10T03:54:09.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.741+0000 7f8c2939d640 1 Processor -- start 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.741+0000 7f8c2939d640 1 -- start start 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.741+0000 7f8c2939d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c24139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c24145b00 0x7f8c241f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c240c9500 0x7f8c240c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24071370 con 0x7f8c10004d40 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c241488c0 con 0x7f8c24145b00 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8c240714f0 con 0x7f8c240c9500 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c24139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c24139400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52836/0 (socket says 172.21.15.55:52836) 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 -- 172.21.15.55:0/3513164152 learned_addr learned my addr 172.21.15.55:0/3513164152 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 -- 172.21.15.55:0/3513164152 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c240c9500 msgr2=0x7f8c240c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c240c9500 0x7f8c240c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 -- 172.21.15.55:0/3513164152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c24145b00 msgr2=0x7f8c241f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c24145b00 0x7f8c241f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 -- 172.21.15.55:0/3513164152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c241f47e0 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c24139400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c14007310 tx=0x7f8c140077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401a070 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1400f9a0 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c24146280 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400fd90 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.742+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c24146840 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.743+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2406a7e0 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.744+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c1401d070 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.744+0000 7f8c1bfff640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8c04076300 0x7f8c040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.745+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f8c14097170 con 0x7f8c10004d40 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.745+0000 7f8c1a7fc640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8c04076300 0x7f8c040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:09.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.745+0000 7f8c1a7fc640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8c04076300 0x7f8c040787c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c24147b70 tx=0x7f8c0c0095d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.749+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c140609d0 con 0x7f8c10004d40 2024-05-10T03:54:09.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:09.979+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8c240b4190 con 0x7f8c10004d40 2024-05-10T03:54:10.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.623+0000 7f8c1bfff640 1 -- 172.21.15.55:0/3513164152 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f8c140602d0 con 0x7f8c10004d40 2024-05-10T03:54:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8c04076300 msgr2=0x7f8c040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8c04076300 0x7f8c040787c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c24147b70 tx=0x7f8c0c0095d0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 msgr2=0x7f8c24139400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c24139400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c14007310 tx=0x7f8c140077d0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 shutdown_connections 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c240c9500 0x7f8c240c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c24145b00 0x7f8c241f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8c04076300 0x7f8c040787c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 --2- 172.21.15.55:0/3513164152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c10004d40 0x7f8c24139400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.626+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 >> 172.21.15.55:0/3513164152 conn(0x7f8c2406de10 msgr2=0x7f8c240b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.627+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 shutdown_connections 2024-05-10T03:54:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.627+0000 7f8c2939d640 1 -- 172.21.15.55:0/3513164152 wait complete. 2024-05-10T03:54:10.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T03:54:10.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.752+0000 7f56da0b0640 1 Processor -- start 2024-05-10T03:54:10.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.752+0000 7f56da0b0640 1 -- start start 2024-05-10T03:54:10.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56da0b0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f56d40d2520 0x7f56d40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:10.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56da0b0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56d41607a0 0x7f56d40b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56da0b0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d415fa60 con 0x7f56d40d2900 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56da0b0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f56d406f2d0 con 0x7f56d41607a0 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56da0b0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f56d415fce0 con 0x7f56d40d2520 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56d41607a0 0x7f56d40b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56d40d2900 0x7f56d406e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59188/0 (socket says 172.21.15.55:59188) 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d3fff640 1 -- 172.21.15.55:0/2885272725 learned_addr learned my addr 172.21.15.55:0/2885272725 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56d41607a0 0x7f56d40b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52850/0 (socket says 172.21.15.55:52850) 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d37fe640 1 --2- 172.21.15.55:0/2885272725 >> v2:172.21.15.64:3300/0 conn(0x7f56d40d2520 0x7f56d40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d2ffd640 1 -- 172.21.15.55:0/2885272725 >> v2:172.21.15.64:3300/0 conn(0x7f56d40d2520 msgr2=0x7f56d40b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d2ffd640 1 --2- 172.21.15.55:0/2885272725 >> v2:172.21.15.64:3300/0 conn(0x7f56d40d2520 0x7f56d40b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d2ffd640 1 -- 172.21.15.55:0/2885272725 >> v1:172.21.15.55:6789/0 conn(0x7f56d40d2900 legacy=0x7f56d406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:10.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.753+0000 7f56d2ffd640 1 -- 172.21.15.55:0/2885272725 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d415ffc0 con 0x7f56d41607a0 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.754+0000 7f56d2ffd640 1 --2- 172.21.15.55:0/2885272725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41607a0 0x7f56d40b5560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56d40cfae0 tx=0x7f56c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7069649e7046be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.754+0000 7f56d27fc640 1 -- 172.21.15.55:0/2885272725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8037070 con 0x7f56d41607a0 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.754+0000 7f56d27fc640 1 -- 172.21.15.55:0/2885272725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8032440 con 0x7f56d41607a0 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.754+0000 7f56d27fc640 1 -- 172.21.15.55:0/2885272725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8032810 con 0x7f56d41607a0 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 -- 172.21.15.55:0/2885272725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41607a0 msgr2=0x7f56d40b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 --2- 172.21.15.55:0/2885272725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41607a0 0x7f56d40b5560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f56d40cfae0 tx=0x7f56c802a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 -- 172.21.15.55:0/2885272725 shutdown_connections 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 --2- 172.21.15.55:0/2885272725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d41607a0 0x7f56d40b5560 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 --2- 172.21.15.55:0/2885272725 >> v2:172.21.15.64:3300/0 conn(0x7f56d40d2520 0x7f56d40b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 -- 172.21.15.55:0/2885272725 >> 172.21.15.55:0/2885272725 conn(0x7f56d406c780 msgr2=0x7f56d406cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:10.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 -- 172.21.15.55:0/2885272725 shutdown_connections 2024-05-10T03:54:10.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.755+0000 7f56da0b0640 1 -- 172.21.15.55:0/2885272725 wait complete. 2024-05-10T03:54:10.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.756+0000 7f56da0b0640 1 Processor -- start 2024-05-10T03:54:10.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.756+0000 7f56da0b0640 1 -- start start 2024-05-10T03:54:10.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56da0b0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d40d2520 0x7f56d40cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:10.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56da0b0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 0x7f56d41460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:10.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56da0b0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d4146860 0x7f56d40ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:10.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56da0b0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f56d406ee00 con 0x7f56d40d2900 2024-05-10T03:54:10.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56da0b0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56d406ec80 con 0x7f56d40d2520 2024-05-10T03:54:10.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56da0b0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f56d406ef80 con 0x7f56d4146860 2024-05-10T03:54:10.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 0x7f56d41460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:10.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 0x7f56d41460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52864/0 (socket says 172.21.15.55:52864) 2024-05-10T03:54:10.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 -- 172.21.15.55:0/1513824030 learned_addr learned my addr 172.21.15.55:0/1513824030 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:10.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d37fe640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d40d2520 0x7f56d40cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:10.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d3fff640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d4146860 0x7f56d40ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:10.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 -- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d4146860 msgr2=0x7f56d40ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:10.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d4146860 0x7f56d40ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 -- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d40d2520 msgr2=0x7f56d40cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:10.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d40d2520 0x7f56d40cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:10.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d2ffd640 1 -- 172.21.15.55:0/1513824030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d4161ea0 con 0x7f56d40d2900 2024-05-10T03:54:10.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d3fff640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d4146860 0x7f56d40ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:10.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.757+0000 7f56d37fe640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d40d2520 0x7f56d40cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:10.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.758+0000 7f56d2ffd640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 0x7f56d41460b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009890 tx=0x7f56c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:10.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.758+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8037040 con 0x7f56d40d2900 2024-05-10T03:54:10.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.758+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8042070 con 0x7f56d40d2900 2024-05-10T03:54:10.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.758+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d4162180 con 0x7f56d40d2900 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.758+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8030bd0 con 0x7f56d40d2900 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.758+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d415ace0 con 0x7f56d40d2900 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.759+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d406a7e0 con 0x7f56d40d2900 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.759+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56c8047460 con 0x7f56d40d2900 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.760+0000 7f56bbfff640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56c00762d0 0x7f56c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.760+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f56c80b8250 con 0x7f56d40d2900 2024-05-10T03:54:10.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.760+0000 7f56d37fe640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56c00762d0 0x7f56c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:10.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.761+0000 7f56d37fe640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56c00762d0 0x7f56c0078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:10.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.764+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56c8032e20 con 0x7f56d40d2900 2024-05-10T03:54:10.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:10.955+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f56d40d0a30 con 0x7f56d40d2900 2024-05-10T03:54:11.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:54:11.587 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:54:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.626+0000 7f56bbfff640 1 -- 172.21.15.55:0/1513824030 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f56c8081ac0 con 0x7f56d40d2900 2024-05-10T03:54:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-05-10T03:54:11.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56c00762d0 msgr2=0x7f56c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:11.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56c00762d0 0x7f56c0078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56c4006fd0 tx=0x7f56c4008040 comp rx=0 tx=0).stop 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 msgr2=0x7f56d41460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 0x7f56d41460b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009890 tx=0x7f56c80046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 shutdown_connections 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d4146860 0x7f56d40ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f56c00762d0 0x7f56c0078790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d40d2900 0x7f56d41460b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 --2- 172.21.15.55:0/1513824030 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d40d2520 0x7f56d40cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.629+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 >> 172.21.15.55:0/1513824030 conn(0x7f56d406c780 msgr2=0x7f56d4070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.630+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 shutdown_connections 2024-05-10T03:54:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.630+0000 7f56da0b0640 1 -- 172.21.15.55:0/1513824030 wait complete. 2024-05-10T03:54:11.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T03:54:11.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.798+0000 7fd98dfc1640 1 Processor -- start 2024-05-10T03:54:11.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.799+0000 7fd98dfc1640 1 -- start start 2024-05-10T03:54:11.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.799+0000 7fd98dfc1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9880b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:11.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.799+0000 7fd98dfc1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9880719b0 0x7fd9880b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:11.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.799+0000 7fd98dfc1640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98815f790 con 0x7fd98815f3b0 2024-05-10T03:54:11.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.799+0000 7fd98dfc1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fd9880afa10 con 0x7fd9880719b0 2024-05-10T03:54:11.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.799+0000 7fd98dfc1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd9880afcf0 con 0x7fd98806caa0 2024-05-10T03:54:11.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9880719b0 0x7fd9880b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9880719b0 0x7fd9880b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52872/0 (socket says 172.21.15.55:52872) 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 -- 172.21.15.55:0/3484023167 learned_addr learned my addr 172.21.15.55:0/3484023167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd986ffd640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9880b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 -- 172.21.15.55:0/3484023167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 msgr2=0x7fd9880b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9880b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 -- 172.21.15.55:0/3484023167 >> v1:172.21.15.64:6789/0 conn(0x7fd98815f3b0 legacy=0x7fd98806c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd987fff640 1 -- 172.21.15.55:0/3484023167 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9880affd0 con 0x7fd9880719b0 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.800+0000 7fd986ffd640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9880b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd987fff640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9880b5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd980009e50 tx=0x7fd98002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b168aaf557bfcea2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd9867fc640 1 -- 172.21.15.55:0/3484023167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980036070 con 0x7fd9880719b0 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd9867fc640 1 -- 172.21.15.55:0/3484023167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980031600 con 0x7fd9880719b0 2024-05-10T03:54:11.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd9867fc640 1 -- 172.21.15.55:0/3484023167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800319d0 con 0x7fd9880719b0 2024-05-10T03:54:11.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 -- 172.21.15.55:0/3484023167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 msgr2=0x7fd9880b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:11.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9880b5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd980009e50 tx=0x7fd98002a710 comp rx=0 tx=0).stop 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 -- 172.21.15.55:0/3484023167 shutdown_connections 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9880b5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/3484023167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9880b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 -- 172.21.15.55:0/3484023167 >> 172.21.15.55:0/3484023167 conn(0x7fd9880b3d40 msgr2=0x7fd9880b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 -- 172.21.15.55:0/3484023167 shutdown_connections 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.801+0000 7fd98dfc1640 1 -- 172.21.15.55:0/3484023167 wait complete. 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.803+0000 7fd98dfc1640 1 Processor -- start 2024-05-10T03:54:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.803+0000 7fd98dfc1640 1 -- start start 2024-05-10T03:54:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.803+0000 7fd98dfc1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9881e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.803+0000 7fd98dfc1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9881f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.803+0000 7fd98dfc1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98815f3b0 0x7fd9881e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd98dfc1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd9880af6c0 con 0x7fd9880719b0 2024-05-10T03:54:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd98dfc1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd9880b0590 con 0x7fd98815f3b0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd98dfc1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd9880b0ab0 con 0x7fd98806caa0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9881f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9881f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52876/0 (socket says 172.21.15.55:52876) 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 -- 172.21.15.55:0/648358018 learned_addr learned my addr 172.21.15.55:0/648358018 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd987fff640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98815f3b0 0x7fd9881e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd9877fe640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9881e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 -- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 msgr2=0x7fd9881e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9881e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 -- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98815f3b0 msgr2=0x7fd9881e82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98815f3b0 0x7fd9881e82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 -- 172.21.15.55:0/648358018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd988157680 con 0x7fd9880719b0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd987fff640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98815f3b0 0x7fd9881e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd986ffd640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9881f6360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e810 tx=0x7fd97c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c017070 con 0x7fd9880719b0 2024-05-10T03:54:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c00c6d0 con 0x7fd9880719b0 2024-05-10T03:54:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9881f68a0 con 0x7fd9880719b0 2024-05-10T03:54:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00f040 con 0x7fd9880719b0 2024-05-10T03:54:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.804+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd988157c00 con 0x7fd9880719b0 2024-05-10T03:54:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.805+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98806a7e0 con 0x7fd9880719b0 2024-05-10T03:54:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.806+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd97c01a070 con 0x7fd9880719b0 2024-05-10T03:54:11.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.806+0000 7fd96ffff640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd9740762d0 0x7fd974078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:11.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.807+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7fd97c097030 con 0x7fd9880719b0 2024-05-10T03:54:11.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.807+0000 7fd9877fe640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd9740762d0 0x7fd974078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:11.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.807+0000 7fd9877fe640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd9740762d0 0x7fd974078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd9780015e0 tx=0x7fd978009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:11.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:11.811+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd97c060b80 con 0x7fd9880719b0 2024-05-10T03:54:12.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.007+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd988160db0 con 0x7fd9880719b0 2024-05-10T03:54:12.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.632+0000 7fd96ffff640 1 -- 172.21.15.55:0/648358018 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7fd97c060480 con 0x7fd9880719b0 2024-05-10T03:54:12.635 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-05-10T03:54:12.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd9740762d0 msgr2=0x7fd974078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:12.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd9740762d0 0x7fd974078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd9780015e0 tx=0x7fd978009040 comp rx=0 tx=0).stop 2024-05-10T03:54:12.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 msgr2=0x7fd9881f6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:12.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9881f6360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e810 tx=0x7fd97c00ecd0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 shutdown_connections 2024-05-10T03:54:12.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd98815f3b0 0x7fd9881e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd9740762d0 0x7fd974078790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9880719b0 0x7fd9881f6360 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.634+0000 7fd98dfc1640 1 --2- 172.21.15.55:0/648358018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd98806caa0 0x7fd9881e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.635+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 >> 172.21.15.55:0/648358018 conn(0x7fd9880b3d40 msgr2=0x7fd9880b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:12.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.635+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 shutdown_connections 2024-05-10T03:54:12.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.636+0000 7fd98dfc1640 1 -- 172.21.15.55:0/648358018 wait complete. 2024-05-10T03:54:12.654 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T03:54:12.654 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T03:54:12.654 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T03:54:12.654 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:54:12.655 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T03:54:12.655 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T03:54:12.655 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T03:54:12.655 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:54:12.655 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T03:54:12.655 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T03:54:12.655 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T03:54:12.655 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:54:12.656 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T03:54:12.656 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T03:54:12.656 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T03:54:12.656 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:54:12.666 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T03:54:12.666 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T03:54:12.667 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T03:54:12.667 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T03:54:12.668 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T03:54:12.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T03:54:12.669 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T03:54:12.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T03:54:12.708 INFO:tasks.ceph.mds.b:Started 2024-05-10T03:54:12.708 DEBUG:teuthology.parallel:result is None 2024-05-10T03:54:12.709 INFO:tasks.ceph.mds.d:Started 2024-05-10T03:54:12.709 DEBUG:teuthology.parallel:result is None 2024-05-10T03:54:12.711 INFO:tasks.ceph.mds.a:Started 2024-05-10T03:54:12.711 DEBUG:teuthology.parallel:result is None 2024-05-10T03:54:12.712 INFO:tasks.ceph.mds.c:Started 2024-05-10T03:54:12.712 DEBUG:teuthology.parallel:result is None 2024-05-10T03:54:12.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T03:54:12.786 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2024-05-10T03:54:12.786 INFO:tasks.ceph.mds.d.smithi064.stdout:starting mds.d at 2024-05-10T03:54:12.795 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-05-10T03:54:12.795 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-05-10T03:54:12.795 INFO:tasks.ceph.mds.c.smithi055.stderr:2024-05-10T03:54:12.793+0000 7f2d8fcc6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-10T03:54:12.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.822+0000 7f1162809640 1 Processor -- start 2024-05-10T03:54:12.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.822+0000 7f1162809640 1 -- start start 2024-05-10T03:54:12.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1162809640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f115c0b4e20 0x7f115c06ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:12.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1162809640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115c160370 0x7f115c1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1162809640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c06f250 con 0x7f115c0b0eb0 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1162809640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f115c160820 con 0x7f115c160370 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1162809640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f115c06f530 con 0x7f115c0b4e20 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115c160370 0x7f115c1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115c160370 0x7f115c1559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52906/0 (socket says 172.21.15.55:52906) 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 -- 172.21.15.55:0/44714999 learned_addr learned my addr 172.21.15.55:0/44714999 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f115b7fe640 1 --2- 172.21.15.55:0/44714999 >> v2:172.21.15.64:3300/0 conn(0x7f115c0b4e20 0x7f115c06ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 -- 172.21.15.55:0/44714999 >> v2:172.21.15.64:3300/0 conn(0x7f115c0b4e20 msgr2=0x7f115c06ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 --2- 172.21.15.55:0/44714999 >> v2:172.21.15.64:3300/0 conn(0x7f115c0b4e20 0x7f115c06ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 -- 172.21.15.55:0/44714999 >> v1:172.21.15.64:6789/0 conn(0x7f115c0b0eb0 legacy=0x7f115c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.823+0000 7f1160da6640 1 -- 172.21.15.55:0/44714999 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c06f810 con 0x7f115c160370 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.824+0000 7f1160da6640 1 --2- 172.21.15.55:0/44714999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c160370 0x7f115c1559e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f115c068740 tx=0x7f115402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0f9f2166f376c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.824+0000 7f115affd640 1 -- 172.21.15.55:0/44714999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154036070 con 0x7f115c160370 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.824+0000 7f115affd640 1 -- 172.21.15.55:0/44714999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1154031600 con 0x7f115c160370 2024-05-10T03:54:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.824+0000 7f115affd640 1 -- 172.21.15.55:0/44714999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540319d0 con 0x7f115c160370 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 -- 172.21.15.55:0/44714999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c160370 msgr2=0x7f115c1559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 --2- 172.21.15.55:0/44714999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c160370 0x7f115c1559e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f115c068740 tx=0x7f115402a730 comp rx=0 tx=0).stop 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 -- 172.21.15.55:0/44714999 shutdown_connections 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 --2- 172.21.15.55:0/44714999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c160370 0x7f115c1559e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 --2- 172.21.15.55:0/44714999 >> v2:172.21.15.64:3300/0 conn(0x7f115c0b4e20 0x7f115c06ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 -- 172.21.15.55:0/44714999 >> 172.21.15.55:0/44714999 conn(0x7f115c0d1760 msgr2=0x7f115c0d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 -- 172.21.15.55:0/44714999 shutdown_connections 2024-05-10T03:54:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.825+0000 7f1162809640 1 -- 172.21.15.55:0/44714999 wait complete. 2024-05-10T03:54:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.826+0000 7f1162809640 1 Processor -- start 2024-05-10T03:54:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.826+0000 7f1162809640 1 -- start start 2024-05-10T03:54:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1162809640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f115c0b0eb0 0x7f115c1f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1162809640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 0x7f115c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1162809640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f115c160370 0x7f115c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1162809640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1560a0 con 0x7f115c0b4e20 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1162809640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f115c155f20 con 0x7f115c160370 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1162809640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f115c156220 con 0x7f115c0b0eb0 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 0x7f115c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 0x7f115c157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52914/0 (socket says 172.21.15.55:52914) 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f115c0b0eb0 0x7f115c1f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 -- 172.21.15.55:0/3538776195 learned_addr learned my addr 172.21.15.55:0/3538776195 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f1160da6640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f115c160370 0x7f115c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 -- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f115c0b0eb0 msgr2=0x7f115c1f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f115c0b0eb0 0x7f115c1f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 -- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f115c160370 msgr2=0x7f115c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f115c160370 0x7f115c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115b7fe640 1 -- 172.21.15.55:0/3538776195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c157ee0 con 0x7f115c0b4e20 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.827+0000 7f115bfff640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f115c0b0eb0 0x7f115c1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.828+0000 7f115b7fe640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 0x7f115c157370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f115000e9b0 tx=0x7f115000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.828+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150017070 con 0x7f115c0b4e20 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.828+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115000c9a0 con 0x7f115c0b4e20 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.828+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c1f8530 con 0x7f115c0b4e20 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.828+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000cd90 con 0x7f115c0b4e20 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.828+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c1f9010 con 0x7f115c0b4e20 2024-05-10T03:54:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.829+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115c06a7e0 con 0x7f115c0b4e20 2024-05-10T03:54:12.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.829+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f115001a070 con 0x7f115c0b4e20 2024-05-10T03:54:12.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.830+0000 7f1158ff9640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f11480762d0 0x7f1148078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:12.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.830+0000 7f115bfff640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f11480762d0 0x7f1148078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:12.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.830+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f1150097240 con 0x7f115c0b4e20 2024-05-10T03:54:12.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.830+0000 7f115bfff640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f11480762d0 0x7f1148078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f114c001bb0 tx=0x7f114c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:12.834+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1150060850 con 0x7f115c0b4e20 2024-05-10T03:54:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.037+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f115c06fe40 con 0x7f115c0b4e20 2024-05-10T03:54:13.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.661+0000 7f1158ff9640 1 -- 172.21.15.55:0/3538776195 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f1150064b50 con 0x7f115c0b4e20 2024-05-10T03:54:13.665 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f11480762d0 msgr2=0x7f1148078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f11480762d0 0x7f1148078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f114c001bb0 tx=0x7f114c009040 comp rx=0 tx=0).stop 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 msgr2=0x7f115c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 0x7f115c157370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f115000e9b0 tx=0x7f115000ee70 comp rx=0 tx=0).stop 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 shutdown_connections 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f115c160370 0x7f115c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f11480762d0 0x7f1148078790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115c0b4e20 0x7f115c157370 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 --2- 172.21.15.55:0/3538776195 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f115c0b0eb0 0x7f115c1f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 >> 172.21.15.55:0/3538776195 conn(0x7f115c0d1760 msgr2=0x7f115c068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 shutdown_connections 2024-05-10T03:54:13.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.665+0000 7f1162809640 1 -- 172.21.15.55:0/3538776195 wait complete. 2024-05-10T03:54:13.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T03:54:13.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.794+0000 7f9e88324640 1 Processor -- start 2024-05-10T03:54:13.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.794+0000 7f9e88324640 1 -- start start 2024-05-10T03:54:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e88324640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e88324640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e8015f830 0x7f9e800b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e88324640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e800b5da0 con 0x7f9e800d03b0 2024-05-10T03:54:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e88324640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f9e80163460 con 0x7f9e8015f830 2024-05-10T03:54:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e88324640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800b6080 con 0x7f9e8015f450 2024-05-10T03:54:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e858bf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e8015f830 0x7f9e800b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e858bf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e8015f830 0x7f9e800b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52926/0 (socket says 172.21.15.55:52926) 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e858bf640 1 -- 172.21.15.55:0/2993555937 learned_addr learned my addr 172.21.15.55:0/2993555937 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.795+0000 7f9e860c0640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.796+0000 7f9e858bf640 1 -- 172.21.15.55:0/2993555937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 msgr2=0x7f9e800cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.796+0000 7f9e858bf640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.796+0000 7f9e858bf640 1 -- 172.21.15.55:0/2993555937 >> v1:172.21.15.64:6789/0 conn(0x7f9e800d03b0 legacy=0x7f9e800d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.796+0000 7f9e858bf640 1 -- 172.21.15.55:0/2993555937 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800d3020 con 0x7f9e8015f830 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.796+0000 7f9e860c0640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e858bf640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e800b5200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25a1488e68f72dc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e850be640 1 -- 172.21.15.55:0/2993555937 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74037070 con 0x7f9e8015f830 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e850be640 1 -- 172.21.15.55:0/2993555937 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e74032440 con 0x7f9e8015f830 2024-05-10T03:54:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e850be640 1 -- 172.21.15.55:0/2993555937 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74032810 con 0x7f9e8015f830 2024-05-10T03:54:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 -- 172.21.15.55:0/2993555937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 msgr2=0x7f9e800b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e800b5200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402a270 comp rx=0 tx=0).stop 2024-05-10T03:54:13.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 -- 172.21.15.55:0/2993555937 shutdown_connections 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e800b5200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 --2- 172.21.15.55:0/2993555937 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 -- 172.21.15.55:0/2993555937 >> 172.21.15.55:0/2993555937 conn(0x7f9e8008ec90 msgr2=0x7f9e8009e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 -- 172.21.15.55:0/2993555937 shutdown_connections 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.797+0000 7f9e88324640 1 -- 172.21.15.55:0/2993555937 wait complete. 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 Processor -- start 2024-05-10T03:54:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 -- start start 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800d03b0 0x7f9e8015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e8015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d5af0 con 0x7f9e8015f830 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d5970 con 0x7f9e800d03b0 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.799+0000 7f9e88324640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800b5740 con 0x7f9e8015f450 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e8015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e860c0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800d03b0 0x7f9e8015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e8015dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52936/0 (socket says 172.21.15.55:52936) 2024-05-10T03:54:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 -- 172.21.15.55:0/2188121819 learned_addr learned my addr 172.21.15.55:0/2188121819 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e858bf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 -- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 msgr2=0x7f9e800cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 -- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800d03b0 msgr2=0x7f9e8015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800d03b0 0x7f9e8015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 -- 172.21.15.55:0/2188121819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800cc8f0 con 0x7f9e8015f830 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e860c0640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800d03b0 0x7f9e8015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e868c1640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e8015dc10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c3c0 tx=0x7f9e7800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780052d0 con 0x7f9e8015f830 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e78005490 con 0x7f9e8015f830 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78007260 con 0x7f9e8015f830 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e800ccbd0 con 0x7f9e8015f830 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.800+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e800cd190 con 0x7f9e8015f830 2024-05-10T03:54:13.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.801+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8006a7e0 con 0x7f9e8015f830 2024-05-10T03:54:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.802+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e78007400 con 0x7f9e8015f830 2024-05-10T03:54:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.802+0000 7f9e7effd640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9e6c076300 0x7f9e6c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.802+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f9e78096720 con 0x7f9e8015f830 2024-05-10T03:54:13.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.802+0000 7f9e860c0640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9e6c076300 0x7f9e6c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.803+0000 7f9e860c0640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9e6c076300 0x7f9e6c0787c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e801f8890 tx=0x7f9e7000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:13.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:13.807+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e7805fce0 con 0x7f9e8015f830 2024-05-10T03:54:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.069+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9e800d61c0 con 0x7f9e8015f830 2024-05-10T03:54:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.070+0000 7f9e7effd640 1 -- 172.21.15.55:0/2188121819 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f9e78068320 con 0x7f9e8015f830 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1mzxy7BxAAY2dL925JVAS/+ZCl6OKPgA==", 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.073 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1mN5I2FBAAMCWI/cQsF/3Qm1Rj3PA/gg==", 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.074 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1moFAPDxAA/C8V8fr8Rf/vW10SRpLxIg==", 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.075 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1mto+qGxAAalU+JMiTMsfDkIEckuRdSw==", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQATmj1mkKDXDRAAMArE+5U8EDDHFLoMNAnCTA==", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAWmj1m/dryDRAAmGUWXsLMVm6OYMZQ+7HK+Q==", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAZmj1mT7/CDRAAbayfjejxrqzmuLNa4iFczw==", 2024-05-10T03:54:14.077 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAcmj1mghd0DRAAOJIq1/TorjYtLFBUPG5MjA==", 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.078 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAimj1m1sOqGRAAPdCJjatdUG/OKdW/3vy6KQ==", 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAlmj1m7KFoGBAAJVSg+dlhEIdKFhYM3S0y4g==", 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.079 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAomj1mtfOiFxAA21Pjqv6zT3WUEaxALsp8BA==", 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.080 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQArmj1m8U1nFhAA0+zOd4scNmuxMqHptmP1uw==", 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1ml0IAIBAA93lk8/YccGFOF3TeM3QGRw==", 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1molWkJhAAQalj3qj0hmSf1BWAng0mJw==", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-10T03:54:14.082 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1m4iJRIxAAFaJZvJnNefYwuMOdFDkh1w==", 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-05-10T03:54:14.083 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1miNZQLBAAAWhWNARxpP1VQuSUxu8gqg==", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALmj1mwJHRJRAAY/IQq4CpTS8UGow62iXVgg==", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-10T03:54:14.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAxmj1m2vvlEhAAs9boCTRzbWwnEITGZjG8QA==", 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2024-05-10T03:54:14.085 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAxmj1mkATmEhAA7VBuUMtLurICqAJAmnLMEw==", 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAxmj1mAA3mEhAAbkyD/EEgxGFzhf+oEQWX9w==", 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.086 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAxmj1mPxTmEhAAKU1/wEmd7L8VndFPLULeqA==", 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAxmj1m8hvmEhAAGRKn8C+ZeCxm3Lo5C2UrxA==", 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.087 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAxmj1moSPmEhAARPLV6sjCNYVt2F9KWGgCwA==", 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAMmj1mhVtfBBAAO536wo2uSIfTmI2iEwY51A==", 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.088 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALmj1mlEFyOxAA+zR7KPskG6BW+lijjptHwg==", 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-05-10T03:54:14.089 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:14.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.071+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9e6c076300 msgr2=0x7f9e6c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9e6c076300 0x7f9e6c0787c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e801f8890 tx=0x7f9e7000b040 comp rx=0 tx=0).stop 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 msgr2=0x7f9e8015dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e8015dc10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c3c0 tx=0x7f9e7800c7c0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 shutdown_connections 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9e6c076300 0x7f9e6c0787c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e8015f830 0x7f9e8015dc10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e8015f450 0x7f9e800cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 --2- 172.21.15.55:0/2188121819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e800d03b0 0x7f9e8015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 >> 172.21.15.55:0/2188121819 conn(0x7f9e8008ec90 msgr2=0x7f9e8006d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 shutdown_connections 2024-05-10T03:54:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.072+0000 7f9e88324640 1 -- 172.21.15.55:0/2188121819 wait complete. 2024-05-10T03:54:14.092 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-10T03:54:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.193+0000 7f09af189640 1 Processor -- start 2024-05-10T03:54:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.193+0000 7f09af189640 1 -- start start 2024-05-10T03:54:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09af189640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f09a815f510 0x7f09a8073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09af189640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80d2e60 con 0x7f09a80b1140 2024-05-10T03:54:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09af189640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a806d250 con 0x7f09a806caa0 2024-05-10T03:54:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09af189640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f09a806cf70 con 0x7f09a815f510 2024-05-10T03:54:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f099ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f09a80b1140 0x7f09a806c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59204/0 (socket says 172.21.15.55:59204) 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f099ffff640 1 -- 172.21.15.55:0/1687806732 learned_addr learned my addr 172.21.15.55:0/1687806732 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09acf25640 1 --2- 172.21.15.55:0/1687806732 >> v2:172.21.15.64:3300/0 conn(0x7f09a815f510 0x7f09a8073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f099f7fe640 1 -- 172.21.15.55:0/1687806732 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974375050 0 0) 0x7f0998001110 con 0x7f09a80b1140 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f099f7fe640 1 -- 172.21.15.55:0/1687806732 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0990003520 con 0x7f09a80b1140 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09acf25640 1 -- 172.21.15.55:0/1687806732 >> v1:172.21.15.64:6789/0 conn(0x7f09a806caa0 legacy=0x7f09a80708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09acf25640 1 -- 172.21.15.55:0/1687806732 >> v1:172.21.15.55:6789/0 conn(0x7f09a80b1140 legacy=0x7f09a806c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.194+0000 7f09acf25640 1 -- 172.21.15.55:0/1687806732 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a80734b0 con 0x7f09a815f510 2024-05-10T03:54:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.195+0000 7f09acf25640 1 --2- 172.21.15.55:0/1687806732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a8073f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09a40097a0 tx=0x7f09a402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc94124e4841808 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.195+0000 7f099f7fe640 1 -- 172.21.15.55:0/1687806732 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a4037070 con 0x7f09a815f510 2024-05-10T03:54:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.195+0000 7f099f7fe640 1 -- 172.21.15.55:0/1687806732 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a4032440 con 0x7f09a815f510 2024-05-10T03:54:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.195+0000 7f099f7fe640 1 -- 172.21.15.55:0/1687806732 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a40327f0 con 0x7f09a815f510 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 -- 172.21.15.55:0/1687806732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 msgr2=0x7f09a8073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 --2- 172.21.15.55:0/1687806732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a8073f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f09a40097a0 tx=0x7f09a402a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 -- 172.21.15.55:0/1687806732 shutdown_connections 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 --2- 172.21.15.55:0/1687806732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a8073f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 -- 172.21.15.55:0/1687806732 >> 172.21.15.55:0/1687806732 conn(0x7f09a80d2040 msgr2=0x7f09a80d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 -- 172.21.15.55:0/1687806732 shutdown_connections 2024-05-10T03:54:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.196+0000 7f09af189640 1 -- 172.21.15.55:0/1687806732 wait complete. 2024-05-10T03:54:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.197+0000 7f09af189640 1 Processor -- start 2024-05-10T03:54:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.197+0000 7f09af189640 1 -- start start 2024-05-10T03:54:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09af189640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09a806caa0 0x7f09a814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09af189640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 0x7f09a8151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09af189640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a81f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09af189640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f09a80b15d0 con 0x7f09a80b1140 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09af189640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f09a815f8f0 con 0x7f09a815f510 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09af189640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f09a80b1750 con 0x7f09a806caa0 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f099ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 0x7f09a8151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f099ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 0x7f09a8151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52946/0 (socket says 172.21.15.55:52946) 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f099ffff640 1 -- 172.21.15.55:0/3925099747 learned_addr learned my addr 172.21.15.55:0/3925099747 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09acf25640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09a806caa0 0x7f09a814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.198+0000 7f09ad726640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a81f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099ffff640 1 -- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09a806caa0 msgr2=0x7f09a814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099ffff640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09a806caa0 0x7f09a814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099ffff640 1 -- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 msgr2=0x7f09a81f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099ffff640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a81f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099ffff640 1 -- 172.21.15.55:0/3925099747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a8150310 con 0x7f09a80b1140 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099ffff640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 0x7f09a8151c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f099800c760 tx=0x7f099800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998017070 con 0x7f09a80b1140 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0998005ab0 con 0x7f09a80b1140 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a8155b20 con 0x7f09a80b1140 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998007070 con 0x7f09a80b1140 2024-05-10T03:54:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.199+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a81560e0 con 0x7f09a80b1140 2024-05-10T03:54:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.200+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a80aefe0 con 0x7f09a80b1140 2024-05-10T03:54:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.201+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f099801a070 con 0x7f09a80b1140 2024-05-10T03:54:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.201+0000 7f099d7fa640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f09940762d0 0x7f0994078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.202+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f0998096600 con 0x7f09a80b1140 2024-05-10T03:54:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.202+0000 7f09acf25640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f09940762d0 0x7f0994078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.202+0000 7f09acf25640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f09940762d0 0x7f0994078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f09a4034000 tx=0x7f09a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:14.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.206+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f09a80aefe0 con 0x7f09a80b1140 2024-05-10T03:54:14.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.468+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f09a80696d0 con 0x7f09a80b1140 2024-05-10T03:54:14.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.470+0000 7f099d7fa640 1 -- 172.21.15.55:0/3925099747 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f09a80696d0 con 0x7f09a80b1140 2024-05-10T03:54:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.472+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f09940762d0 msgr2=0x7f0994078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.472+0000 7f09af189640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f09940762d0 0x7f0994078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f09a4034000 tx=0x7f09a402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.472+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 msgr2=0x7f09a8151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.472+0000 7f09af189640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 0x7f09a8151c90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f099800c760 tx=0x7f099800cc20 comp rx=0 tx=0).stop 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 shutdown_connections 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09a815f510 0x7f09a81f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f09940762d0 0x7f0994078790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a80b1140 0x7f09a8151c90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 --2- 172.21.15.55:0/3925099747 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09a806caa0 0x7f09a814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 >> 172.21.15.55:0/3925099747 conn(0x7f09a80d2040 msgr2=0x7f09a80ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 shutdown_connections 2024-05-10T03:54:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.473+0000 7f09af189640 1 -- 172.21.15.55:0/3925099747 wait complete. 2024-05-10T03:54:14.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-10T03:54:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.588+0000 7f04afabd640 1 Processor -- start 2024-05-10T03:54:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.588+0000 7f04afabd640 1 -- start start 2024-05-10T03:54:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04afabd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04a815f440 0x7f04a80b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04afabd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04a80d2200 0x7f04a80d3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04afabd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a80d0530 con 0x7f04a8163a00 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04afabd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f04a80d36e0 con 0x7f04a80d2200 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04afabd640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f04a80d0810 con 0x7f04a815f440 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04ae05a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04a80d2200 0x7f04a80d3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04ad058640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04a8163a00 0x7f04a80d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59218/0 (socket says 172.21.15.55:59218) 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.589+0000 7f04ad058640 1 -- 172.21.15.55:0/2569470349 learned_addr learned my addr 172.21.15.55:0/2569470349 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ad859640 1 --2- 172.21.15.55:0/2569470349 >> v2:172.21.15.64:3300/0 conn(0x7f04a815f440 0x7f04a80b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ac857640 1 -- 172.21.15.55:0/2569470349 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175809777 0 0) 0x7f04a80d0530 con 0x7f04a8163a00 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ac857640 1 -- 172.21.15.55:0/2569470349 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0490003520 con 0x7f04a8163a00 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ae05a640 1 -- 172.21.15.55:0/2569470349 >> v2:172.21.15.64:3300/0 conn(0x7f04a815f440 msgr2=0x7f04a80b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ae05a640 1 --2- 172.21.15.55:0/2569470349 >> v2:172.21.15.64:3300/0 conn(0x7f04a815f440 0x7f04a80b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ae05a640 1 -- 172.21.15.55:0/2569470349 >> v1:172.21.15.55:6789/0 conn(0x7f04a8163a00 legacy=0x7f04a80d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ae05a640 1 -- 172.21.15.55:0/2569470349 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a80d0af0 con 0x7f04a80d2200 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.590+0000 7f04ae05a640 1 --2- 172.21.15.55:0/2569470349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a80d2200 0x7f04a80d3b70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04a806dbf0 tx=0x7f049802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4855864ead5097 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04ac857640 1 -- 172.21.15.55:0/2569470349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498007740 con 0x7f04a80d2200 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04ac857640 1 -- 172.21.15.55:0/2569470349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04980078e0 con 0x7f04a80d2200 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04ac857640 1 -- 172.21.15.55:0/2569470349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498007cb0 con 0x7f04a80d2200 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 -- 172.21.15.55:0/2569470349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a80d2200 msgr2=0x7f04a80d3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 --2- 172.21.15.55:0/2569470349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a80d2200 0x7f04a80d3b70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04a806dbf0 tx=0x7f049802a5f0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 -- 172.21.15.55:0/2569470349 shutdown_connections 2024-05-10T03:54:14.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 --2- 172.21.15.55:0/2569470349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a80d2200 0x7f04a80d3b70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 --2- 172.21.15.55:0/2569470349 >> v2:172.21.15.64:3300/0 conn(0x7f04a815f440 0x7f04a80b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 -- 172.21.15.55:0/2569470349 >> 172.21.15.55:0/2569470349 conn(0x7f04a80740f0 msgr2=0x7f04a806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 -- 172.21.15.55:0/2569470349 shutdown_connections 2024-05-10T03:54:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.591+0000 7f04afabd640 1 -- 172.21.15.55:0/2569470349 wait complete. 2024-05-10T03:54:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.592+0000 7f04afabd640 1 Processor -- start 2024-05-10T03:54:14.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.592+0000 7f04afabd640 1 -- start start 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04afabd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f04a80d2200 0x7f04a81f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04afabd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 0x7f04a81600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04afabd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a8163a00 0x7f04a8161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04afabd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f04a80b47a0 con 0x7f04a815f440 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04afabd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f04a80b4620 con 0x7f04a8163a00 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04afabd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f04a80d40b0 con 0x7f04a80d2200 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04ad058640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 0x7f04a81600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04ad058640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 0x7f04a81600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52962/0 (socket says 172.21.15.55:52962) 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04ad058640 1 -- 172.21.15.55:0/2943504848 learned_addr learned my addr 172.21.15.55:0/2943504848 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04ad859640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f04a80d2200 0x7f04a81f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.593+0000 7f04ae05a640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a8163a00 0x7f04a8161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ad058640 1 -- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f04a80d2200 msgr2=0x7f04a81f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ad058640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f04a80d2200 0x7f04a81f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ad058640 1 -- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a8163a00 msgr2=0x7f04a8161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ad058640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a8163a00 0x7f04a8161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ad058640 1 -- 172.21.15.55:0/2943504848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a815b500 con 0x7f04a815f440 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ae05a640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a8163a00 0x7f04a8161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04ad058640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 0x7f04a81600b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f049c00c410 tx=0x7f049c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c017070 con 0x7f04a815f440 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c005ce0 con 0x7f04a815f440 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a815b7e0 con 0x7f04a815f440 2024-05-10T03:54:14.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c0072d0 con 0x7f04a815f440 2024-05-10T03:54:14.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.594+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a815bda0 con 0x7f04a815f440 2024-05-10T03:54:14.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.595+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a80cce10 con 0x7f04a815f440 2024-05-10T03:54:14.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.596+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f049c01a070 con 0x7f04a815f440 2024-05-10T03:54:14.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.596+0000 7f04a67fc640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f04940762d0 0x7f0494078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.596+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f049c096580 con 0x7f04a815f440 2024-05-10T03:54:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.596+0000 7f04ad859640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f04940762d0 0x7f0494078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.597+0000 7f04ad859640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f04940762d0 0x7f0494078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009b40 tx=0x7f04a0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.600+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f049c05fbe0 con 0x7f04a815f440 2024-05-10T03:54:14.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.870+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f04a80d3060 con 0x7f04a815f440 2024-05-10T03:54:14.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.877+0000 7f04a67fc640 1 -- 172.21.15.55:0/2943504848 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f049c063ee0 con 0x7f04a815f440 2024-05-10T03:54:14.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f04940762d0 msgr2=0x7f0494078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f04940762d0 0x7f0494078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009b40 tx=0x7f04a0009190 comp rx=0 tx=0).stop 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 msgr2=0x7f04a81600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 0x7f04a81600b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f049c00c410 tx=0x7f049c00c8d0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 shutdown_connections 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04a8163a00 0x7f04a8161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f04940762d0 0x7f0494078790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04a815f440 0x7f04a81600b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 --2- 172.21.15.55:0/2943504848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f04a80d2200 0x7f04a81f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.878+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 >> 172.21.15.55:0/2943504848 conn(0x7f04a80740f0 msgr2=0x7f04a80cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.879+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 shutdown_connections 2024-05-10T03:54:14.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.879+0000 7f04afabd640 1 -- 172.21.15.55:0/2943504848 wait complete. 2024-05-10T03:54:14.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-10T03:54:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.995+0000 7f98fe1b6640 1 Processor -- start 2024-05-10T03:54:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.995+0000 7f98fe1b6640 1 -- start start 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98fe1b6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f98f80b5fe0 0x7f98f80b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98fe1b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98f8160c40 0x7f98f81610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98fe1b6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f81608d0 con 0x7f98f8148f20 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98fe1b6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f98f806d9b0 con 0x7f98f8160c40 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98fe1b6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f98f806edf0 con 0x7f98f80b5fe0 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98f8160c40 0x7f98f81610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f98f8160c40 0x7f98f81610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52968/0 (socket says 172.21.15.55:52968) 2024-05-10T03:54:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 -- 172.21.15.55:0/2370657898 learned_addr learned my addr 172.21.15.55:0/2370657898 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f6ffd640 1 --2- 172.21.15.55:0/2370657898 >> v2:172.21.15.64:3300/0 conn(0x7f98f80b5fe0 0x7f98f80b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 -- 172.21.15.55:0/2370657898 >> v2:172.21.15.64:3300/0 conn(0x7f98f80b5fe0 msgr2=0x7f98f80b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 --2- 172.21.15.55:0/2370657898 >> v2:172.21.15.64:3300/0 conn(0x7f98f80b5fe0 0x7f98f80b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 -- 172.21.15.55:0/2370657898 >> v1:172.21.15.64:6789/0 conn(0x7f98f8148f20 legacy=0x7f98f806e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.996+0000 7f98f7fff640 1 -- 172.21.15.55:0/2370657898 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f806dc00 con 0x7f98f8160c40 2024-05-10T03:54:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.997+0000 7f98f7fff640 1 --2- 172.21.15.55:0/2370657898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81610b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98f80d2e40 tx=0x7f98f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8288149b5de3973d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.997+0000 7f98f67fc640 1 -- 172.21.15.55:0/2370657898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0036070 con 0x7f98f8160c40 2024-05-10T03:54:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.997+0000 7f98f67fc640 1 -- 172.21.15.55:0/2370657898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f0031600 con 0x7f98f8160c40 2024-05-10T03:54:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.997+0000 7f98f67fc640 1 -- 172.21.15.55:0/2370657898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00319d0 con 0x7f98f8160c40 2024-05-10T03:54:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2370657898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 msgr2=0x7f98f81610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2370657898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81610b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98f80d2e40 tx=0x7f98f002a610 comp rx=0 tx=0).stop 2024-05-10T03:54:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2370657898 shutdown_connections 2024-05-10T03:54:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2370657898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81610b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2370657898 >> v2:172.21.15.64:3300/0 conn(0x7f98f80b5fe0 0x7f98f80b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2370657898 >> 172.21.15.55:0/2370657898 conn(0x7f98f8070730 msgr2=0x7f98f8070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2370657898 shutdown_connections 2024-05-10T03:54:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.998+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2370657898 wait complete. 2024-05-10T03:54:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.999+0000 7f98fe1b6640 1 Processor -- start 2024-05-10T03:54:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:14.999+0000 7f98fe1b6640 1 -- start start 2024-05-10T03:54:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98fe1b6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98f80b5fe0 0x7f98f80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98fe1b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f98f8148f20 0x7f98f80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98fe1b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98fe1b6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81615f0 con 0x7f98f8160c40 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98fe1b6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f98f806e1c0 con 0x7f98f80b5fe0 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98fe1b6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f98f815fb60 con 0x7f98f8148f20 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81f8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52970/0 (socket says 172.21.15.55:52970) 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 -- 172.21.15.55:0/2692978232 learned_addr learned my addr 172.21.15.55:0/2692978232 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f6ffd640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f98f8148f20 0x7f98f80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f77fe640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98f80b5fe0 0x7f98f80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 -- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f98f8148f20 msgr2=0x7f98f80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f98f8148f20 0x7f98f80b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 -- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98f80b5fe0 msgr2=0x7f98f80b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98f80b5fe0 0x7f98f80b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.000+0000 7f98f7fff640 1 -- 172.21.15.55:0/2692978232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f8140830 con 0x7f98f8160c40 2024-05-10T03:54:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.001+0000 7f98f7fff640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81f8120 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f98f0034040 tx=0x7f98f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.001+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0036050 con 0x7f98f8160c40 2024-05-10T03:54:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.001+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f0042070 con 0x7f98f8160c40 2024-05-10T03:54:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.001+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0009510 con 0x7f98f8160c40 2024-05-10T03:54:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.001+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f8140b10 con 0x7f98f8160c40 2024-05-10T03:54:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.001+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81410d0 con 0x7f98f8160c40 2024-05-10T03:54:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.002+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f806a7e0 con 0x7f98f8160c40 2024-05-10T03:54:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.003+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98f0007bd0 con 0x7f98f8160c40 2024-05-10T03:54:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.003+0000 7f98dffff640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98e40762d0 0x7f98e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.003+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f98f00b7f30 con 0x7f98f8160c40 2024-05-10T03:54:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.003+0000 7f98f77fe640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98e40762d0 0x7f98e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.003+0000 7f98f77fe640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98e40762d0 0x7f98e4078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98e8004f60 tx=0x7f98e8007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.007+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98f0081590 con 0x7f98f8160c40 2024-05-10T03:54:15.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.270+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f98f8141ef0 con 0x7f98f8160c40 2024-05-10T03:54:15.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.272+0000 7f98dffff640 1 -- 172.21.15.55:0/2692978232 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f98f0085890 con 0x7f98f8160c40 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98e40762d0 msgr2=0x7f98e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98e40762d0 0x7f98e4078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98e8004f60 tx=0x7f98e8007e30 comp rx=0 tx=0).stop 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 msgr2=0x7f98f81f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81f8120 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f98f0034040 tx=0x7f98f0004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 shutdown_connections 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f98e40762d0 0x7f98e4078790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98f8160c40 0x7f98f81f8120 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f98f8148f20 0x7f98f80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 --2- 172.21.15.55:0/2692978232 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98f80b5fe0 0x7f98f80b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.274+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 >> 172.21.15.55:0/2692978232 conn(0x7f98f8070730 msgr2=0x7f98f8072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:15.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.275+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 shutdown_connections 2024-05-10T03:54:15.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.275+0000 7f98fe1b6640 1 -- 172.21.15.55:0/2692978232 wait complete. 2024-05-10T03:54:15.289 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-10T03:54:15.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.390+0000 7ffbe6124640 1 Processor -- start 2024-05-10T03:54:15.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.391+0000 7ffbe6124640 1 -- start start 2024-05-10T03:54:15.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.391+0000 7ffbe6124640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.391+0000 7ffbe6124640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe01608d0 con 0x7ffbe00b5fe0 2024-05-10T03:54:15.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.391+0000 7ffbe6124640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe006dc00 con 0x7ffbe0161350 2024-05-10T03:54:15.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.391+0000 7ffbe6124640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe006d9b0 con 0x7ffbe0148f20 2024-05-10T03:54:15.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbdeffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffbe00b5fe0 0x7ffbe0160c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59234/0 (socket says 172.21.15.55:59234) 2024-05-10T03:54:15.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbdeffd640 1 -- 172.21.15.55:0/1694406093 learned_addr learned my addr 172.21.15.55:0/1694406093 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbdf7fe640 1 --2- 172.21.15.55:0/1694406093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841467186 0 0) 0x7ffbe01608d0 con 0x7ffbe00b5fe0 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc8003520 con 0x7ffbe00b5fe0 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381753774 0 0) 0x7ffbe006dc00 con 0x7ffbe0161350 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbe01608d0 con 0x7ffbe0161350 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbdf7fe640 1 -- 172.21.15.55:0/1694406093 >> v1:172.21.15.64:6789/0 conn(0x7ffbe0161350 legacy=0x7ffbe015fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2329328288 0 0) 0x7ffbc8003520 con 0x7ffbe00b5fe0 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbdf7fe640 1 -- 172.21.15.55:0/1694406093 >> v1:172.21.15.55:6789/0 conn(0x7ffbe00b5fe0 legacy=0x7ffbe0160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.392+0000 7ffbdf7fe640 1 -- 172.21.15.55:0/1694406093 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe006dee0 con 0x7ffbe0148f20 2024-05-10T03:54:15.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.393+0000 7ffbdf7fe640 1 --2- 172.21.15.55:0/1694406093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe006e6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00097d0 tx=0x7ffbd002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908187178d947310 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.393+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0037070 con 0x7ffbe0148f20 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.393+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd002ab90 con 0x7ffbe0148f20 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.393+0000 7ffbde7fc640 1 -- 172.21.15.55:0/1694406093 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40016f0 con 0x7ffbe0148f20 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 -- 172.21.15.55:0/1694406093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 msgr2=0x7ffbe006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 --2- 172.21.15.55:0/1694406093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe006e6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00097d0 tx=0x7ffbd002a100 comp rx=0 tx=0).stop 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 -- 172.21.15.55:0/1694406093 shutdown_connections 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 --2- 172.21.15.55:0/1694406093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe006e6e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 -- 172.21.15.55:0/1694406093 >> 172.21.15.55:0/1694406093 conn(0x7ffbe0070730 msgr2=0x7ffbe0070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 -- 172.21.15.55:0/1694406093 shutdown_connections 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.394+0000 7ffbe6124640 1 -- 172.21.15.55:0/1694406093 wait complete. 2024-05-10T03:54:15.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.395+0000 7ffbe6124640 1 Processor -- start 2024-05-10T03:54:15.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.395+0000 7ffbe6124640 1 -- start start 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbe6124640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe00b5fe0 0x7ffbe015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbe6124640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbe6124640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 0x7ffbe0071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbe6124640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe006eda0 con 0x7ffbe0161350 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbe6124640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe006ec20 con 0x7ffbe00b5fe0 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbe6124640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe0160270 con 0x7ffbe0148f20 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 0x7ffbe0071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 0x7ffbe0071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52984/0 (socket says 172.21.15.55:52984) 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 -- 172.21.15.55:0/2833136078 learned_addr learned my addr 172.21.15.55:0/2833136078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdeffd640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdf7fe640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe00b5fe0 0x7ffbe015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 -- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 msgr2=0x7ffbe015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 -- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe00b5fe0 msgr2=0x7ffbe015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe00b5fe0 0x7ffbe015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 -- 172.21.15.55:0/2833136078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe01403e0 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdeffd640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.396+0000 7ffbdffff640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 0x7ffbe0071cd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c760 tx=0x7ffbd800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.397+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8003b70 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.397+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe01f99b0 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.397+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd8003d30 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.397+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8005310 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.397+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe013fac0 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.398+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe01f97e0 con 0x7ffbe0161350 2024-05-10T03:54:15.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.398+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffbd80054b0 con 0x7ffbe0161350 2024-05-10T03:54:15.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.399+0000 7ffbc7fff640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ffbcc0762d0 0x7ffbcc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.399+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ffbd80970d0 con 0x7ffbe0161350 2024-05-10T03:54:15.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.399+0000 7ffbdf7fe640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ffbcc0762d0 0x7ffbcc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.399+0000 7ffbdf7fe640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ffbcc0762d0 0x7ffbcc078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0034000 tx=0x7ffbd002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.403+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffbd8060d00 con 0x7ffbe0161350 2024-05-10T03:54:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.666+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ffbe006a7e0 con 0x7ffbe0161350 2024-05-10T03:54:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.671+0000 7ffbc7fff640 1 -- 172.21.15.55:0/2833136078 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ffbd8060600 con 0x7ffbe0161350 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ffbcc0762d0 msgr2=0x7ffbcc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ffbcc0762d0 0x7ffbcc078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0034000 tx=0x7ffbd002e000 comp rx=0 tx=0).stop 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 msgr2=0x7ffbe0071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 0x7ffbe0071cd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c760 tx=0x7ffbd800cc20 comp rx=0 tx=0).stop 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 shutdown_connections 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ffbcc0762d0 0x7ffbcc078790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe0161350 0x7ffbe0071cd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbe0148f20 0x7ffbe015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 --2- 172.21.15.55:0/2833136078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbe00b5fe0 0x7ffbe015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 >> 172.21.15.55:0/2833136078 conn(0x7ffbe0070730 msgr2=0x7ffbe00b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 shutdown_connections 2024-05-10T03:54:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.673+0000 7ffbe6124640 1 -- 172.21.15.55:0/2833136078 wait complete. 2024-05-10T03:54:15.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-10T03:54:15.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.789+0000 7f65139f7640 1 Processor -- start 2024-05-10T03:54:15.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.790+0000 7f65139f7640 1 -- start start 2024-05-10T03:54:15.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.790+0000 7f65139f7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f650c15f690 0x7f650c0d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.790+0000 7f65139f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f650c0d4f20 0x7f650c0d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.790+0000 7f65139f7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650c0d3e80 con 0x7f650c15f2b0 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.790+0000 7f65139f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0b9490 con 0x7f650c0d4f20 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.790+0000 7f65139f7640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f650c0d4160 con 0x7f650c15f690 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f650c0d4f20 0x7f650c0d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f650c0d4f20 0x7f650c0d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43594/0 (socket says 172.21.15.55:43594) 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 -- 172.21.15.55:0/3704028529 learned_addr learned my addr 172.21.15.55:0/3704028529 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 -- 172.21.15.55:0/3704028529 >> v2:172.21.15.64:3300/0 conn(0x7f650c15f690 msgr2=0x7f650c0d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 --2- 172.21.15.55:0/3704028529 >> v2:172.21.15.64:3300/0 conn(0x7f650c15f690 0x7f650c0d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 -- 172.21.15.55:0/3704028529 >> v1:172.21.15.64:6789/0 conn(0x7f650c15f2b0 legacy=0x7f650c0d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:15.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 -- 172.21.15.55:0/3704028529 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c0d4440 con 0x7f650c0d4f20 2024-05-10T03:54:15.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.791+0000 7f6511f94640 1 --2- 172.21.15.55:0/3704028529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c0d4f20 0x7f650c0d2270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f650c0d1a80 tx=0x7f650402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba0a66c119cc094 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f6503fff640 1 -- 172.21.15.55:0/3704028529 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504036070 con 0x7f650c0d4f20 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f6503fff640 1 -- 172.21.15.55:0/3704028529 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6504031600 con 0x7f650c0d4f20 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f6503fff640 1 -- 172.21.15.55:0/3704028529 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65040319d0 con 0x7f650c0d4f20 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 -- 172.21.15.55:0/3704028529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c0d4f20 msgr2=0x7f650c0d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 --2- 172.21.15.55:0/3704028529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c0d4f20 0x7f650c0d2270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f650c0d1a80 tx=0x7f650402a610 comp rx=0 tx=0).stop 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 -- 172.21.15.55:0/3704028529 shutdown_connections 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 --2- 172.21.15.55:0/3704028529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c0d4f20 0x7f650c0d2270 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 --2- 172.21.15.55:0/3704028529 >> v2:172.21.15.64:3300/0 conn(0x7f650c15f690 0x7f650c0d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 -- 172.21.15.55:0/3704028529 >> 172.21.15.55:0/3704028529 conn(0x7f650c0740f0 msgr2=0x7f650c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 -- 172.21.15.55:0/3704028529 shutdown_connections 2024-05-10T03:54:15.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.792+0000 7f65139f7640 1 -- 172.21.15.55:0/3704028529 wait complete. 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 Processor -- start 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 -- start start 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f650c0d4f20 0x7f650c1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 0x7f650c147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c15f690 0x7f650c149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0d3b30 con 0x7f650c15f2b0 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f650c0d4a00 con 0x7f650c15f690 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f65139f7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f650c0bb230 con 0x7f650c0d4f20 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f6510f92640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 0x7f650c147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f6510f92640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 0x7f650c147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43600/0 (socket says 172.21.15.55:43600) 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.794+0000 7f6510f92640 1 -- 172.21.15.55:0/3834123148 learned_addr learned my addr 172.21.15.55:0/3834123148 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:15.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6511793640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f650c0d4f20 0x7f650c1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6511f94640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c15f690 0x7f650c149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6510f92640 1 -- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f650c0d4f20 msgr2=0x7f650c1491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6510f92640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f650c0d4f20 0x7f650c1491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6510f92640 1 -- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c15f690 msgr2=0x7f650c149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6510f92640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c15f690 0x7f650c149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6510f92640 1 -- 172.21.15.55:0/3834123148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650c148150 con 0x7f650c15f2b0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6511f94640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c15f690 0x7f650c149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6510f92640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 0x7f650c147870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b480 tx=0x7f64fc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc014070 con 0x7f650c15f2b0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc010870 con 0x7f650c15f2b0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650c148430 con 0x7f650c15f2b0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc010c60 con 0x7f650c15f2b0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.795+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650c1489f0 con 0x7f650c15f2b0 2024-05-10T03:54:15.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.796+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650c06a7e0 con 0x7f650c15f2b0 2024-05-10T03:54:15.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.797+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64fc017070 con 0x7f650c15f2b0 2024-05-10T03:54:15.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.798+0000 7f6501ffb640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f64f00762d0 0x7f64f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:15.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.798+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f64fc097100 con 0x7f650c15f2b0 2024-05-10T03:54:15.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.798+0000 7f6511793640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f64f00762d0 0x7f64f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:15.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.798+0000 7f6511793640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f64f00762d0 0x7f64f0078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f65080017f0 tx=0x7f6508009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:15.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:15.802+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64fc0606c0 con 0x7f650c15f2b0 2024-05-10T03:54:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.068+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f650c159f50 con 0x7f650c15f2b0 2024-05-10T03:54:16.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.070+0000 7f6501ffb640 1 -- 172.21.15.55:0/3834123148 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f64fc0649c0 con 0x7f650c15f2b0 2024-05-10T03:54:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f64f00762d0 msgr2=0x7f64f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f64f00762d0 0x7f64f0078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f65080017f0 tx=0x7f6508009040 comp rx=0 tx=0).stop 2024-05-10T03:54:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 msgr2=0x7f650c147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 0x7f650c147870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b480 tx=0x7f64fc00b940 comp rx=0 tx=0).stop 2024-05-10T03:54:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 shutdown_connections 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f650c15f690 0x7f650c149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f64f00762d0 0x7f64f0078790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f650c15f2b0 0x7f650c147870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 --2- 172.21.15.55:0/3834123148 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f650c0d4f20 0x7f650c1491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 >> 172.21.15.55:0/3834123148 conn(0x7f650c0740f0 msgr2=0x7f650c0b9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 shutdown_connections 2024-05-10T03:54:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.072+0000 7f65139f7640 1 -- 172.21.15.55:0/3834123148 wait complete. 2024-05-10T03:54:16.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-10T03:54:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.188+0000 7efecd396640 1 Processor -- start 2024-05-10T03:54:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.188+0000 7efecd396640 1 -- start start 2024-05-10T03:54:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efecd396640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efec815ccc0 0x7efec80b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efecd396640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efec815d0a0 0x7efec80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efecd396640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec80b3550 con 0x7efec80b5300 2024-05-10T03:54:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efecd396640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7efec80b3830 con 0x7efec815ccc0 2024-05-10T03:54:16.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efecd396640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7efec80b3ff0 con 0x7efec815d0a0 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efec815ccc0 0x7efec80b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efec815ccc0 0x7efec80b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43610/0 (socket says 172.21.15.55:43610) 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 -- 172.21.15.55:0/459311615 learned_addr learned my addr 172.21.15.55:0/459311615 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec67fc640 1 --2- 172.21.15.55:0/459311615 >> v2:172.21.15.64:3300/0 conn(0x7efec815d0a0 0x7efec80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 -- 172.21.15.55:0/459311615 >> v2:172.21.15.64:3300/0 conn(0x7efec815d0a0 msgr2=0x7efec80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 --2- 172.21.15.55:0/459311615 >> v2:172.21.15.64:3300/0 conn(0x7efec815d0a0 0x7efec80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 -- 172.21.15.55:0/459311615 >> v1:172.21.15.64:6789/0 conn(0x7efec80b5300 legacy=0x7efec80b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec6ffd640 1 -- 172.21.15.55:0/459311615 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80b42d0 con 0x7efec815ccc0 2024-05-10T03:54:16.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.189+0000 7efec67fc640 1 --2- 172.21.15.55:0/459311615 >> v2:172.21.15.64:3300/0 conn(0x7efec815d0a0 0x7efec80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.190+0000 7efec6ffd640 1 --2- 172.21.15.55:0/459311615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec80b4ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efec80d0e90 tx=0x7efec002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c94e7da15b14aa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.190+0000 7efec5ffb640 1 -- 172.21.15.55:0/459311615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec0036070 con 0x7efec815ccc0 2024-05-10T03:54:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.190+0000 7efec5ffb640 1 -- 172.21.15.55:0/459311615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec0031600 con 0x7efec815ccc0 2024-05-10T03:54:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.190+0000 7efec5ffb640 1 -- 172.21.15.55:0/459311615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec00319d0 con 0x7efec815ccc0 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 -- 172.21.15.55:0/459311615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 msgr2=0x7efec80b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 --2- 172.21.15.55:0/459311615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec80b4ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efec80d0e90 tx=0x7efec002a6a0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 -- 172.21.15.55:0/459311615 shutdown_connections 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 --2- 172.21.15.55:0/459311615 >> v2:172.21.15.64:3300/0 conn(0x7efec815d0a0 0x7efec80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 --2- 172.21.15.55:0/459311615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec80b4ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 -- 172.21.15.55:0/459311615 >> 172.21.15.55:0/459311615 conn(0x7efec806c390 msgr2=0x7efec806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 -- 172.21.15.55:0/459311615 shutdown_connections 2024-05-10T03:54:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.191+0000 7efecd396640 1 -- 172.21.15.55:0/459311615 wait complete. 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.192+0000 7efecd396640 1 Processor -- start 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.192+0000 7efecd396640 1 -- start start 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efecd396640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efec80b5300 0x7efec81553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efecd396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec8159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efecd396640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efec815d0a0 0x7efec80ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efecd396640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7efec80b3120 con 0x7efec815ccc0 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efecd396640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efec815d550 con 0x7efec815d0a0 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efecd396640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efec80b32a0 con 0x7efec80b5300 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efec67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec8159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efec67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec8159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43624/0 (socket says 172.21.15.55:43624) 2024-05-10T03:54:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efec67fc640 1 -- 172.21.15.55:0/3092305009 learned_addr learned my addr 172.21.15.55:0/3092305009 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efec6ffd640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efec80b5300 0x7efec81553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.193+0000 7efec77fe640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efec815d0a0 0x7efec80ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec67fc640 1 -- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efec80b5300 msgr2=0x7efec81553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec67fc640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efec80b5300 0x7efec81553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec67fc640 1 -- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efec815d0a0 msgr2=0x7efec80ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec67fc640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efec815d0a0 0x7efec80ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec67fc640 1 -- 172.21.15.55:0/3092305009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec8159660 con 0x7efec815ccc0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec77fe640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efec815d0a0 0x7efec80ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efec67fc640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec8159120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c7f0 tx=0x7efeb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0015070 con 0x7efec815ccc0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0007820 con 0x7efec815ccc0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec8158080 con 0x7efec815ccc0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0007bd0 con 0x7efec815ccc0 2024-05-10T03:54:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.194+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec8158640 con 0x7efec815ccc0 2024-05-10T03:54:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.195+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec806a7e0 con 0x7efec815ccc0 2024-05-10T03:54:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.196+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efeb0018070 con 0x7efec815ccc0 2024-05-10T03:54:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.196+0000 7efebf7fe640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efea80762d0 0x7efea8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.197+0000 7efec6ffd640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efea80762d0 0x7efea8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.197+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7efeb00972e0 con 0x7efec815ccc0 2024-05-10T03:54:16.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.197+0000 7efec6ffd640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efea80762d0 0x7efea8078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efec0033000 tx=0x7efec0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.201+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efeb0061020 con 0x7efec815ccc0 2024-05-10T03:54:16.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.468+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7efec80b59b0 con 0x7efec815ccc0 2024-05-10T03:54:16.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.471+0000 7efebf7fe640 1 -- 172.21.15.55:0/3092305009 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7efeb0060920 con 0x7efec815ccc0 2024-05-10T03:54:16.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efea80762d0 msgr2=0x7efea8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efea80762d0 0x7efea8078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efec0033000 tx=0x7efec0009000 comp rx=0 tx=0).stop 2024-05-10T03:54:16.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 msgr2=0x7efec8159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec8159120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efeb000c7f0 tx=0x7efeb000ccb0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 shutdown_connections 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efec815d0a0 0x7efec80ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efea80762d0 0x7efea8078790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efec815ccc0 0x7efec8159120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 --2- 172.21.15.55:0/3092305009 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efec80b5300 0x7efec81553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 >> 172.21.15.55:0/3092305009 conn(0x7efec806c390 msgr2=0x7efec80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 shutdown_connections 2024-05-10T03:54:16.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.473+0000 7efecd396640 1 -- 172.21.15.55:0/3092305009 wait complete. 2024-05-10T03:54:16.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T03:54:16.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.589+0000 7f5491dc8640 1 Processor -- start 2024-05-10T03:54:16.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.589+0000 7f5491dc8640 1 -- start start 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f5491dc8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f548c15f450 0x7f548c0cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f5491dc8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f548c0b5910 0x7f548c0d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f5491dc8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548c0b5da0 con 0x7f548c15f830 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f5491dc8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f548c163460 con 0x7f548c0b5910 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f5491dc8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f548c0b6080 con 0x7f548c15f450 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f548c0b5910 0x7f548c0d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f548c0b5910 0x7f548c0d5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43634/0 (socket says 172.21.15.55:43634) 2024-05-10T03:54:16.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 -- 172.21.15.55:0/915546992 learned_addr learned my addr 172.21.15.55:0/915546992 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:16.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 -- 172.21.15.55:0/915546992 >> v2:172.21.15.64:3300/0 conn(0x7f548c15f450 msgr2=0x7f548c0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:16.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 --2- 172.21.15.55:0/915546992 >> v2:172.21.15.64:3300/0 conn(0x7f548c15f450 0x7f548c0cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 -- 172.21.15.55:0/915546992 >> v1:172.21.15.64:6789/0 conn(0x7f548c15f830 legacy=0x7f548c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:16.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.590+0000 7f548bfff640 1 -- 172.21.15.55:0/915546992 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c0d3020 con 0x7f548c0b5910 2024-05-10T03:54:16.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.591+0000 7f548bfff640 1 --2- 172.21.15.55:0/915546992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c0b5910 0x7f548c0d5260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f548c08f110 tx=0x7f548402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06c4c45ca5ba3d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.591+0000 7f548a7fc640 1 -- 172.21.15.55:0/915546992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484036070 con 0x7f548c0b5910 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.591+0000 7f548a7fc640 1 -- 172.21.15.55:0/915546992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484031600 con 0x7f548c0b5910 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.591+0000 7f548a7fc640 1 -- 172.21.15.55:0/915546992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54840319d0 con 0x7f548c0b5910 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.591+0000 7f5491dc8640 1 -- 172.21.15.55:0/915546992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c0b5910 msgr2=0x7f548c0d5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.591+0000 7f5491dc8640 1 --2- 172.21.15.55:0/915546992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c0b5910 0x7f548c0d5260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f548c08f110 tx=0x7f548402a6a0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.592+0000 7f5491dc8640 1 -- 172.21.15.55:0/915546992 shutdown_connections 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.592+0000 7f5491dc8640 1 --2- 172.21.15.55:0/915546992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c0b5910 0x7f548c0d5260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.592+0000 7f5491dc8640 1 --2- 172.21.15.55:0/915546992 >> v2:172.21.15.64:3300/0 conn(0x7f548c15f450 0x7f548c0cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.592+0000 7f5491dc8640 1 -- 172.21.15.55:0/915546992 >> 172.21.15.55:0/915546992 conn(0x7f548c08ec90 msgr2=0x7f548c09e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.592+0000 7f5491dc8640 1 -- 172.21.15.55:0/915546992 shutdown_connections 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.592+0000 7f5491dc8640 1 -- 172.21.15.55:0/915546992 wait complete. 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.593+0000 7f5491dc8640 1 Processor -- start 2024-05-10T03:54:16.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.593+0000 7f5491dc8640 1 -- start start 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f548c15f450 0x7f548c15e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 0x7f548c0ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f548c0b88d0 0x7f548c0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f548c0d0530 con 0x7f548c15f830 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f548c0d03b0 con 0x7f548c15f450 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f548c0d57a0 con 0x7f548c0b88d0 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 0x7f548c0ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 0x7f548c0ba6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43648/0 (socket says 172.21.15.55:43648) 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 -- 172.21.15.55:0/3405084985 learned_addr learned my addr 172.21.15.55:0/3405084985 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548bfff640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f548c0b88d0 0x7f548c0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548b7fe640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f548c15f450 0x7f548c15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 -- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f548c0b88d0 msgr2=0x7f548c0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f548c0b88d0 0x7f548c0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 -- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f548c15f450 msgr2=0x7f548c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f548c15f450 0x7f548c15e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 -- 172.21.15.55:0/3405084985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c15eba0 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548b7fe640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f548c15f450 0x7f548c15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f548affd640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 0x7f548c0ba6a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f548000b3f0 tx=0x7f548000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480015020 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5480011830 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c0b8d60 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480011c00 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.594+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c0b9320 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.595+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548c06a7e0 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.596+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5480018020 con 0x7f548c15f830 2024-05-10T03:54:16.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.597+0000 7f5473fff640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54780762d0 0x7f5478078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.597+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f5480097190 con 0x7f548c15f830 2024-05-10T03:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.597+0000 7f548b7fe640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54780762d0 0x7f5478078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.597+0000 7f548b7fe640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54780762d0 0x7f5478078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f547c006fd0 tx=0x7f547c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.601+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f548001f020 con 0x7f548c15f830 2024-05-10T03:54:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.793+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f548c0d61c0 con 0x7f548c15f830 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.794+0000 7f5473fff640 1 -- 172.21.15.55:0/3405084985 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f54800607f0 con 0x7f548c15f830 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:16.797 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54780762d0 msgr2=0x7f5478078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54780762d0 0x7f5478078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f547c006fd0 tx=0x7f547c008040 comp rx=0 tx=0).stop 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 msgr2=0x7f548c0ba6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 0x7f548c0ba6a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f548000b3f0 tx=0x7f548000b8b0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 shutdown_connections 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f548c0b88d0 0x7f548c0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54780762d0 0x7f5478078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f548c15f830 0x7f548c0ba6a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 --2- 172.21.15.55:0/3405084985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f548c15f450 0x7f548c15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 >> 172.21.15.55:0/3405084985 conn(0x7f548c08ec90 msgr2=0x7f548c06d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 shutdown_connections 2024-05-10T03:54:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.796+0000 7f5491dc8640 1 -- 172.21.15.55:0/3405084985 wait complete. 2024-05-10T03:54:16.810 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T03:54:16.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T03:54:16.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.915+0000 7fd2e6009640 1 Processor -- start 2024-05-10T03:54:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.915+0000 7fd2e6009640 1 -- start start 2024-05-10T03:54:16.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2e6009640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e00d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2e6009640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 0x7fd2e015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2e6009640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e00d2590 con 0x7fd2e00d21b0 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2e6009640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e00d4180 con 0x7fd2e00d3d20 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2e6009640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e00d1190 con 0x7fd2e00d2fe0 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e00d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2dffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 0x7fd2e015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e00d37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:46926/0 (socket says 172.21.15.55:46926) 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 -- 172.21.15.55:0/1713957067 learned_addr learned my addr 172.21.15.55:0/1713957067 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2dffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 0x7fd2e015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:53690/0 (socket says 172.21.15.55:53690) 2024-05-10T03:54:16.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2df7fe640 1 --1- 172.21.15.55:0/1713957067 >> v1:172.21.15.64:6789/0 conn(0x7fd2e00d21b0 0x7fd2e00cfda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:38574/0 (socket says 172.21.15.55:38574) 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 -- 172.21.15.55:0/1713957067 >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 msgr2=0x7fd2e015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 --2- 172.21.15.55:0/1713957067 >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 0x7fd2e015ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 -- 172.21.15.55:0/1713957067 >> v1:172.21.15.64:6789/0 conn(0x7fd2e00d21b0 legacy=0x7fd2e00cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2d7fff640 1 -- 172.21.15.55:0/1713957067 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e00d0610 con 0x7fd2e00d2fe0 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.916+0000 7fd2dffff640 1 --2- 172.21.15.55:0/1713957067 >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 0x7fd2e015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.917+0000 7fd2d7fff640 1 --2- 172.21.15.55:0/1713957067 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e00d37e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009870 tx=0x7fd2c802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd12cae5c5462e36 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.917+0000 7fd2deffd640 1 -- 172.21.15.55:0/1713957067 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8037070 con 0x7fd2e00d2fe0 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.917+0000 7fd2deffd640 1 -- 172.21.15.55:0/1713957067 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8032440 con 0x7fd2e00d2fe0 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.917+0000 7fd2deffd640 1 -- 172.21.15.55:0/1713957067 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032810 con 0x7fd2e00d2fe0 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 -- 172.21.15.55:0/1713957067 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 msgr2=0x7fd2e00d37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1713957067 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e00d37e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009870 tx=0x7fd2c802a1c0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 -- 172.21.15.55:0/1713957067 shutdown_connections 2024-05-10T03:54:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1713957067 >> v2:172.21.15.64:3300/0 conn(0x7fd2e00d3d20 0x7fd2e015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1713957067 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e00d37e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 -- 172.21.15.55:0/1713957067 >> 172.21.15.55:0/1713957067 conn(0x7fd2e009e540 msgr2=0x7fd2e00d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 -- 172.21.15.55:0/1713957067 shutdown_connections 2024-05-10T03:54:16.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.918+0000 7fd2e6009640 1 -- 172.21.15.55:0/1713957067 wait complete. 2024-05-10T03:54:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.919+0000 7fd2e6009640 1 Processor -- start 2024-05-10T03:54:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.919+0000 7fd2e6009640 1 -- start start 2024-05-10T03:54:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2e6009640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2e00d21b0 0x7fd2e00ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2e6009640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e0157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2e6009640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 0x7fd2e00b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2e6009640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00d0bd0 con 0x7fd2e00d3d20 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2e6009640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00d6170 con 0x7fd2e00d21b0 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2e6009640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e00d0eb0 con 0x7fd2e00d2fe0 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 0x7fd2e00b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 0x7fd2e00b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43652/0 (socket says 172.21.15.55:43652) 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 -- 172.21.15.55:0/1084284512 learned_addr learned my addr 172.21.15.55:0/1084284512 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2d7fff640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2df7fe640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2e00d21b0 0x7fd2e00ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 -- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 msgr2=0x7fd2e0157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e0157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 -- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2e00d21b0 msgr2=0x7fd2e00ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2e00d21b0 0x7fd2e00ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.920+0000 7fd2dffff640 1 -- 172.21.15.55:0/1084284512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e00b8d30 con 0x7fd2e00d3d20 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.921+0000 7fd2dffff640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 0x7fd2e00b87f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800efc0 tx=0x7fd2d8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.921+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8018030 con 0x7fd2e00d3d20 2024-05-10T03:54:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.921+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d800cde0 con 0x7fd2e00d3d20 2024-05-10T03:54:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.921+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e00b9c60 con 0x7fd2e00d3d20 2024-05-10T03:54:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.921+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003bb0 con 0x7fd2e00d3d20 2024-05-10T03:54:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.921+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e00ba220 con 0x7fd2e00d3d20 2024-05-10T03:54:16.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.922+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e00b4430 con 0x7fd2e00d3d20 2024-05-10T03:54:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.922+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2d801b070 con 0x7fd2e00d3d20 2024-05-10T03:54:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.923+0000 7fd2dcff9640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd2c0076300 0x7fd2c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.923+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd2d8097b10 con 0x7fd2e00d3d20 2024-05-10T03:54:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.923+0000 7fd2df7fe640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd2c0076300 0x7fd2c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:16.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.923+0000 7fd2df7fe640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd2c0076300 0x7fd2c00787c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0000f60 tx=0x7fd2d0000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:16.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:16.927+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd2e00b4430 con 0x7fd2e00d3d20 2024-05-10T03:54:17.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.117+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd2e006a7e0 con 0x7fd2e00d3d20 2024-05-10T03:54:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.682+0000 7fd2dcff9640 1 -- 172.21.15.55:0/1084284512 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7fd2d8010040 con 0x7fd2e00d3d20 2024-05-10T03:54:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-05-10T03:54:17.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.684+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd2c0076300 msgr2=0x7fd2c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:17.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.684+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd2c0076300 0x7fd2c00787c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0000f60 tx=0x7fd2d0000bc0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.684+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 msgr2=0x7fd2e00b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.684+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 0x7fd2e00b87f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800efc0 tx=0x7fd2d8009f90 comp rx=0 tx=0).stop 2024-05-10T03:54:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 shutdown_connections 2024-05-10T03:54:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd2c0076300 0x7fd2c00787c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2e00d3d20 0x7fd2e00b87f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd2e00d2fe0 0x7fd2e0157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 --2- 172.21.15.55:0/1084284512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2e00d21b0 0x7fd2e00ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 >> 172.21.15.55:0/1084284512 conn(0x7fd2e009e540 msgr2=0x7fd2e006df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 shutdown_connections 2024-05-10T03:54:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.685+0000 7fd2e6009640 1 -- 172.21.15.55:0/1084284512 wait complete. 2024-05-10T03:54:17.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T03:54:17.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.817+0000 7eff903da640 1 Processor -- start 2024-05-10T03:54:17.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.817+0000 7eff903da640 1 -- start start 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff903da640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7eff8815f5f0 0x7eff880d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff903da640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff880b73e0 0x7eff880b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff903da640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff880d3cc0 con 0x7eff880d37d0 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff903da640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7eff880d48d0 con 0x7eff880b73e0 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff903da640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7eff880d3fa0 con 0x7eff8815f5f0 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff880b73e0 0x7eff880b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff880b73e0 0x7eff880b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43654/0 (socket says 172.21.15.55:43654) 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 -- 172.21.15.55:0/761069925 learned_addr learned my addr 172.21.15.55:0/761069925 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 -- 172.21.15.55:0/761069925 >> v2:172.21.15.64:3300/0 conn(0x7eff8815f5f0 msgr2=0x7eff880d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:17.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 --2- 172.21.15.55:0/761069925 >> v2:172.21.15.64:3300/0 conn(0x7eff8815f5f0 0x7eff880d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 -- 172.21.15.55:0/761069925 >> v1:172.21.15.64:6789/0 conn(0x7eff880d37d0 legacy=0x7eff880b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:17.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.818+0000 7eff8e977640 1 -- 172.21.15.55:0/761069925 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff880d4280 con 0x7eff880b73e0 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.819+0000 7eff8e977640 1 --2- 172.21.15.55:0/761069925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff880b73e0 0x7eff880b82c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff8806e3b0 tx=0x7eff8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978c3b0a10c195e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.819+0000 7eff8d174640 1 -- 172.21.15.55:0/761069925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80036070 con 0x7eff880b73e0 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.819+0000 7eff8d174640 1 -- 172.21.15.55:0/761069925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff80031600 con 0x7eff880b73e0 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.819+0000 7eff8d174640 1 -- 172.21.15.55:0/761069925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800319d0 con 0x7eff880b73e0 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.819+0000 7eff903da640 1 -- 172.21.15.55:0/761069925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff880b73e0 msgr2=0x7eff880b82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.819+0000 7eff903da640 1 --2- 172.21.15.55:0/761069925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff880b73e0 0x7eff880b82c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff8806e3b0 tx=0x7eff8002a6a0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.820+0000 7eff903da640 1 -- 172.21.15.55:0/761069925 shutdown_connections 2024-05-10T03:54:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.820+0000 7eff903da640 1 --2- 172.21.15.55:0/761069925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff880b73e0 0x7eff880b82c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.820+0000 7eff903da640 1 --2- 172.21.15.55:0/761069925 >> v2:172.21.15.64:3300/0 conn(0x7eff8815f5f0 0x7eff880d3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.820+0000 7eff903da640 1 -- 172.21.15.55:0/761069925 >> 172.21.15.55:0/761069925 conn(0x7eff880740f0 msgr2=0x7eff880d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.820+0000 7eff903da640 1 -- 172.21.15.55:0/761069925 shutdown_connections 2024-05-10T03:54:17.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.820+0000 7eff903da640 1 -- 172.21.15.55:0/761069925 wait complete. 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.821+0000 7eff903da640 1 Processor -- start 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.821+0000 7eff903da640 1 -- start start 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff880b73e0 0x7eff88162080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7eff880d37d0 0x7eff8815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 0x7eff8814d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7eff880bb1f0 con 0x7eff8815f5f0 2024-05-10T03:54:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7eff880bb070 con 0x7eff880b73e0 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7eff880d4d60 con 0x7eff880d37d0 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 0x7eff8814d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 0x7eff8814d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43660/0 (socket says 172.21.15.55:43660) 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 -- 172.21.15.55:0/674525191 learned_addr learned my addr 172.21.15.55:0/674525191 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e176640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff880b73e0 0x7eff88162080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8d975640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7eff880d37d0 0x7eff8815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 -- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7eff880d37d0 msgr2=0x7eff8815f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7eff880d37d0 0x7eff8815f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 -- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff880b73e0 msgr2=0x7eff88162080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff880b73e0 0x7eff88162080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 -- 172.21.15.55:0/674525191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff88160220 con 0x7eff8815f5f0 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e176640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff880b73e0 0x7eff88162080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8d975640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7eff880d37d0 0x7eff8815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:17.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff8e977640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 0x7eff8814d540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff80034040 tx=0x7eff80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:17.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80041020 con 0x7eff8815f5f0 2024-05-10T03:54:17.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff80007780 con 0x7eff8815f5f0 2024-05-10T03:54:17.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff88160500 con 0x7eff8815f5f0 2024-05-10T03:54:17.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80036040 con 0x7eff8815f5f0 2024-05-10T03:54:17.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.822+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff88160ac0 con 0x7eff8815f5f0 2024-05-10T03:54:17.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.823+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff88160ea0 con 0x7eff8815f5f0 2024-05-10T03:54:17.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.824+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff80044020 con 0x7eff8815f5f0 2024-05-10T03:54:17.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.825+0000 7eff7affd640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7eff6c0762d0 0x7eff6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:17.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.825+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7eff800b8240 con 0x7eff8815f5f0 2024-05-10T03:54:17.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.825+0000 7eff8e176640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7eff6c0762d0 0x7eff6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:17.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.825+0000 7eff8e176640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7eff6c0762d0 0x7eff6c078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00a870 tx=0x7eff7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:17.829+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff88160ea0 con 0x7eff8815f5f0 2024-05-10T03:54:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.022+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7eff8806a7e0 con 0x7eff8815f5f0 2024-05-10T03:54:18.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.690+0000 7eff7affd640 1 -- 172.21.15.55:0/674525191 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7eff8004b030 con 0x7eff8815f5f0 2024-05-10T03:54:18.693 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7eff6c0762d0 msgr2=0x7eff6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7eff6c0762d0 0x7eff6c078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00a870 tx=0x7eff7c008040 comp rx=0 tx=0).stop 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 msgr2=0x7eff8814d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 0x7eff8814d540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7eff80034040 tx=0x7eff80004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 shutdown_connections 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7eff6c0762d0 0x7eff6c078790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff8815f5f0 0x7eff8814d540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7eff880d37d0 0x7eff8815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 --2- 172.21.15.55:0/674525191 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff880b73e0 0x7eff88162080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 >> 172.21.15.55:0/674525191 conn(0x7eff880740f0 msgr2=0x7eff880d1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 shutdown_connections 2024-05-10T03:54:18.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.693+0000 7eff903da640 1 -- 172.21.15.55:0/674525191 wait complete. 2024-05-10T03:54:18.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T03:54:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.831+0000 7fa5bdfdd640 1 Processor -- start 2024-05-10T03:54:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.831+0000 7fa5bdfdd640 1 -- start start 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5bdfdd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5b80b5570 0x7fa5b815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5bdfdd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b80732f0 con 0x7fa5b815b8d0 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5bdfdd640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b80735d0 con 0x7fa5b80b50c0 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5bdfdd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa5b815bcb0 con 0x7fa5b80b5570 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5b6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5b80b5570 0x7fa5b815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5b77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5b815b8d0 0x7fa5b80b49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54278/0 (socket says 172.21.15.55:54278) 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5b77fe640 1 -- 172.21.15.55:0/1760624450 learned_addr learned my addr 172.21.15.55:0/1760624450 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5b6ffd640 1 -- 172.21.15.55:0/1760624450 >> v1:172.21.15.64:6789/0 conn(0x7fa5b80b50c0 legacy=0x7fa5b815c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5b6ffd640 1 -- 172.21.15.55:0/1760624450 >> v1:172.21.15.55:6789/0 conn(0x7fa5b815b8d0 legacy=0x7fa5b80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.832+0000 7fa5b6ffd640 1 -- 172.21.15.55:0/1760624450 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b80738b0 con 0x7fa5b80b5570 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.833+0000 7fa5b6ffd640 1 --2- 172.21.15.55:0/1760624450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b5570 0x7fa5b815bf00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0097a0 tx=0x7fa5ac02b190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d56d344894daa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.833+0000 7fa5b67fc640 1 -- 172.21.15.55:0/1760624450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac038070 con 0x7fa5b80b5570 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.833+0000 7fa5b67fc640 1 -- 172.21.15.55:0/1760624450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ac02be20 con 0x7fa5b80b5570 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.833+0000 7fa5b67fc640 1 -- 172.21.15.55:0/1760624450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac033660 con 0x7fa5b80b5570 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/1760624450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b5570 msgr2=0x7fa5b815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/1760624450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b5570 0x7fa5b815bf00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0097a0 tx=0x7fa5ac02b190 comp rx=0 tx=0).stop 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/1760624450 shutdown_connections 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/1760624450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b5570 0x7fa5b815bf00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/1760624450 >> 172.21.15.55:0/1760624450 conn(0x7fa5b806c390 msgr2=0x7fa5b806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/1760624450 shutdown_connections 2024-05-10T03:54:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.834+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/1760624450 wait complete. 2024-05-10T03:54:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.835+0000 7fa5bdfdd640 1 Processor -- start 2024-05-10T03:54:18.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.835+0000 7fa5bdfdd640 1 -- start start 2024-05-10T03:54:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5bdfdd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 0x7fa5b81f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5bdfdd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5b80b5570 0x7fa5b81552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5bdfdd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5b815b8d0 0x7fa5b81445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:18.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5bdfdd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b80b44f0 con 0x7fa5b80b50c0 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5bdfdd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b8073e70 con 0x7fa5b80b5570 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5bdfdd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b80b4670 con 0x7fa5b815b8d0 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 0x7fa5b81f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 0x7fa5b81f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43686/0 (socket says 172.21.15.55:43686) 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 -- 172.21.15.55:0/2470070986 learned_addr learned my addr 172.21.15.55:0/2470070986 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b6ffd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5b80b5570 0x7fa5b81552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b7fff640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5b815b8d0 0x7fa5b81445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 -- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5b815b8d0 msgr2=0x7fa5b81445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5b815b8d0 0x7fa5b81445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 -- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5b80b5570 msgr2=0x7fa5b81552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5b80b5570 0x7fa5b81552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b77fe640 1 -- 172.21.15.55:0/2470070986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b81f4720 con 0x7fa5b80b50c0 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b6ffd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5b80b5570 0x7fa5b81552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:18.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.836+0000 7fa5b7fff640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5b815b8d0 0x7fa5b81445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.837+0000 7fa5b77fe640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 0x7fa5b81f40f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c730 tx=0x7fa5a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.837+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8018070 con 0x7fa5b80b50c0 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.837+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a80072d0 con 0x7fa5b80b50c0 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.837+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b81f4a00 con 0x7fa5b80b50c0 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.837+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80047e0 con 0x7fa5b80b50c0 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.837+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b81f4fc0 con 0x7fa5b80b50c0 2024-05-10T03:54:18.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.838+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b806a7e0 con 0x7fa5b80b50c0 2024-05-10T03:54:18.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.839+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5a801b070 con 0x7fa5b80b50c0 2024-05-10T03:54:18.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.839+0000 7fa59ffff640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5a40762d0 0x7fa5a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:18.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.839+0000 7fa5b6ffd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5a40762d0 0x7fa5a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:18.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.839+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7fa5a8096a20 con 0x7fa5b80b50c0 2024-05-10T03:54:18.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.840+0000 7fa5b6ffd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5a40762d0 0x7fa5a4078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac035000 tx=0x7fa5ac02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:18.844+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5a8060410 con 0x7fa5b80b50c0 2024-05-10T03:54:19.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.075+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa5b8074330 con 0x7fa5b80b50c0 2024-05-10T03:54:19.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.692+0000 7fa59ffff640 1 -- 172.21.15.55:0/2470070986 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fa5a805fd10 con 0x7fa5b80b50c0 2024-05-10T03:54:19.695 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 4 and data pool 5 2024-05-10T03:54:19.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5a40762d0 msgr2=0x7fa5a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:19.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5a40762d0 0x7fa5a4078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac035000 tx=0x7fa5ac02f000 comp rx=0 tx=0).stop 2024-05-10T03:54:19.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 msgr2=0x7fa5b81f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:19.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 0x7fa5b81f40f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c730 tx=0x7fa5a800cbf0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 shutdown_connections 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5b815b8d0 0x7fa5b81445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5b80b5570 0x7fa5b81552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5a40762d0 0x7fa5a4078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 --2- 172.21.15.55:0/2470070986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5b80b50c0 0x7fa5b81f40f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.695+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 >> 172.21.15.55:0/2470070986 conn(0x7fa5b806c390 msgr2=0x7fa5b80b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.696+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 shutdown_connections 2024-05-10T03:54:19.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.696+0000 7fa5bdfdd640 1 -- 172.21.15.55:0/2470070986 wait complete. 2024-05-10T03:54:19.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:19.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.834+0000 7f28c7d11640 1 Processor -- start 2024-05-10T03:54:19.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.834+0000 7f28c7d11640 1 -- start start 2024-05-10T03:54:19.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c7d11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28c0163cb0 0x7f28c00d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:19.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c7d11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c009bcb0 con 0x7f28c0163080 2024-05-10T03:54:19.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c7d11640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c009bf90 con 0x7f28c015f770 2024-05-10T03:54:19.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c7d11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f28c009ba60 con 0x7f28c0163cb0 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c52ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28c0163cb0 0x7f28c00d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c5aad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28c0163080 0x7f28c0163460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54290/0 (socket says 172.21.15.55:54290) 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c52ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28c0163cb0 0x7f28c00d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43696/0 (socket says 172.21.15.55:43696) 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c5aad640 1 -- 172.21.15.55:0/1882125181 learned_addr learned my addr 172.21.15.55:0/1882125181 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c52ac640 1 -- 172.21.15.55:0/1882125181 >> v1:172.21.15.64:6789/0 conn(0x7f28c015f770 legacy=0x7f28c015fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.835+0000 7f28c52ac640 1 -- 172.21.15.55:0/1882125181 >> v1:172.21.15.55:6789/0 conn(0x7f28c0163080 legacy=0x7f28c0163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:19.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.836+0000 7f28c52ac640 1 -- 172.21.15.55:0/1882125181 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c009c270 con 0x7f28c0163cb0 2024-05-10T03:54:19.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.836+0000 7f28c52ac640 1 --2- 172.21.15.55:0/1882125181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c0163cb0 0x7f28c00d1d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28b00097a0 tx=0x7f28b002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647a89e6bffe7f70 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:19.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.836+0000 7f28c4aab640 1 -- 172.21.15.55:0/1882125181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0037070 con 0x7f28c0163cb0 2024-05-10T03:54:19.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.836+0000 7f28c4aab640 1 -- 172.21.15.55:0/1882125181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b0032440 con 0x7f28c0163cb0 2024-05-10T03:54:19.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.836+0000 7f28c4aab640 1 -- 172.21.15.55:0/1882125181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0032810 con 0x7f28c0163cb0 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 -- 172.21.15.55:0/1882125181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c0163cb0 msgr2=0x7f28c00d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 --2- 172.21.15.55:0/1882125181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c0163cb0 0x7f28c00d1d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28b00097a0 tx=0x7f28b002a210 comp rx=0 tx=0).stop 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 -- 172.21.15.55:0/1882125181 shutdown_connections 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 --2- 172.21.15.55:0/1882125181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c0163cb0 0x7f28c00d1d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 -- 172.21.15.55:0/1882125181 >> 172.21.15.55:0/1882125181 conn(0x7f28c00b4d70 msgr2=0x7f28c00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 -- 172.21.15.55:0/1882125181 shutdown_connections 2024-05-10T03:54:19.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.837+0000 7f28c7d11640 1 -- 172.21.15.55:0/1882125181 wait complete. 2024-05-10T03:54:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.838+0000 7f28c7d11640 1 Processor -- start 2024-05-10T03:54:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.838+0000 7f28c7d11640 1 -- start start 2024-05-10T03:54:19.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c7d11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 0x7f28c00cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c7d11640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28c0163080 0x7f28c01f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c7d11640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28c0163cb0 0x7f28c01f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c7d11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f28c00d2250 con 0x7f28c015f770 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c7d11640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f28c009c830 con 0x7f28c0163080 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c7d11640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f28c00cef80 con 0x7f28c0163cb0 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 0x7f28c00cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 0x7f28c00cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43704/0 (socket says 172.21.15.55:43704) 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 -- 172.21.15.55:0/3198100704 learned_addr learned my addr 172.21.15.55:0/3198100704 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c52ac640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28c0163080 0x7f28c01f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c62ae640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28c0163cb0 0x7f28c01f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 -- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28c0163cb0 msgr2=0x7f28c01f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28c0163cb0 0x7f28c01f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 -- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28c0163080 msgr2=0x7f28c01f9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:19.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28c0163080 0x7f28c01f9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c5aad640 1 -- 172.21.15.55:0/3198100704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c015df40 con 0x7f28c015f770 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c52ac640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28c0163080 0x7f28c01f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.839+0000 7f28c62ae640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28c0163cb0 0x7f28c01f98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.840+0000 7f28c5aad640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 0x7f28c00cb7b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00c4d0 tx=0x7f28bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.840+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc017070 con 0x7f28c015f770 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.840+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc005d00 con 0x7f28c015f770 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.840+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c00ccdb0 con 0x7f28c015f770 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.840+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0072b0 con 0x7f28c015f770 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.840+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c00cafb0 con 0x7f28c015f770 2024-05-10T03:54:19.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.841+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c00a1390 con 0x7f28c015f770 2024-05-10T03:54:19.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.842+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f28bc01a070 con 0x7f28c015f770 2024-05-10T03:54:19.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.842+0000 7f28b67fc640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f28a4076300 0x7f28a40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:19.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.842+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f28bc096990 con 0x7f28c015f770 2024-05-10T03:54:19.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.842+0000 7f28c52ac640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f28a4076300 0x7f28a40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:19.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.843+0000 7f28c52ac640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f28a4076300 0x7f28a40787c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28b0034000 tx=0x7f28b002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:19.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:19.847+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f28bc0602f0 con 0x7f28c015f770 2024-05-10T03:54:20.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.039+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28c0050820 con 0x7f28c015f770 2024-05-10T03:54:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.040+0000 7f28b67fc640 1 -- 172.21.15.55:0/3198100704 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16586 (secure 0 0 0) 0x7f28bc05fbf0 con 0x7f28c015f770 2024-05-10T03:54:20.043 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:20.043 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:54:19.076365+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:54:17.121690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T03:54:18.026924+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.042+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f28a4076300 msgr2=0x7f28a40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.042+0000 7f28c7d11640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f28a4076300 0x7f28a40787c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28b0034000 tx=0x7f28b002e000 comp rx=0 tx=0).stop 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.042+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 msgr2=0x7f28c00cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 0x7f28c00cb7b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f28bc00c4d0 tx=0x7f28bc00c990 comp rx=0 tx=0).stop 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 shutdown_connections 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28c0163cb0 0x7f28c01f98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28c0163080 0x7f28c01f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f28a4076300 0x7f28a40787c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 --2- 172.21.15.55:0/3198100704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28c015f770 0x7f28c00cb7b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 >> 172.21.15.55:0/3198100704 conn(0x7f28c00b4d70 msgr2=0x7f28c015e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 shutdown_connections 2024-05-10T03:54:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.043+0000 7f28c7d11640 1 -- 172.21.15.55:0/3198100704 wait complete. 2024-05-10T03:54:20.057 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:20.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.158+0000 7f9e06b7f640 1 Processor -- start 2024-05-10T03:54:20.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.158+0000 7f9e06b7f640 1 -- start start 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e06b7f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e00163460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e06b7f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e0015f770 0x7f9e0015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e06b7f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e001639a0 con 0x7f9e00163cb0 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e06b7f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0009ba60 con 0x7f9e0015f770 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e06b7f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0009bcb0 con 0x7f9e00163080 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e0511c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e0015f770 0x7f9e0015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9df7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9e00163cb0 0x7f9e000d1d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54296/0 (socket says 172.21.15.55:54296) 2024-05-10T03:54:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9df7fff640 1 -- 172.21.15.55:0/1486002491 learned_addr learned my addr 172.21.15.55:0/1486002491 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e0491b640 1 --2- 172.21.15.55:0/1486002491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e00163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e0511c640 1 -- 172.21.15.55:0/1486002491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 msgr2=0x7f9e00163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e0511c640 1 --2- 172.21.15.55:0/1486002491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e00163460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e0511c640 1 -- 172.21.15.55:0/1486002491 >> v1:172.21.15.55:6789/0 conn(0x7f9e00163cb0 legacy=0x7f9e000d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.159+0000 7f9e0511c640 1 -- 172.21.15.55:0/1486002491 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0009bf90 con 0x7f9e0015f770 2024-05-10T03:54:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.160+0000 7f9e0511c640 1 --2- 172.21.15.55:0/1486002491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e0015f770 0x7f9e0015fba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009d90 tx=0x7f9df802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b1b722fe178dc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.160+0000 7f9df77fe640 1 -- 172.21.15.55:0/1486002491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8007740 con 0x7f9e0015f770 2024-05-10T03:54:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.160+0000 7f9df77fe640 1 -- 172.21.15.55:0/1486002491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80078e0 con 0x7f9e0015f770 2024-05-10T03:54:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.160+0000 7f9df77fe640 1 -- 172.21.15.55:0/1486002491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8007cb0 con 0x7f9e0015f770 2024-05-10T03:54:20.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1486002491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e0015f770 msgr2=0x7f9e0015fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1486002491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e0015f770 0x7f9e0015fba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009d90 tx=0x7f9df802a6f0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1486002491 shutdown_connections 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1486002491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e0015f770 0x7f9e0015fba0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1486002491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e00163460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1486002491 >> 172.21.15.55:0/1486002491 conn(0x7f9e000b4d70 msgr2=0x7f9e000b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1486002491 shutdown_connections 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.161+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1486002491 wait complete. 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.162+0000 7f9e06b7f640 1 Processor -- start 2024-05-10T03:54:20.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.162+0000 7f9e06b7f640 1 -- start start 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e06b7f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e0015f770 0x7f9e001578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e06b7f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e000b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e06b7f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 0x7f9e0006df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e06b7f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0009c830 con 0x7f9e00163cb0 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e06b7f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0009c550 con 0x7f9e0015f770 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e06b7f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9e000cef80 con 0x7f9e00163080 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 0x7f9e0006df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 0x7f9e0006df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43718/0 (socket says 172.21.15.55:43718) 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 -- 172.21.15.55:0/1563069590 learned_addr learned my addr 172.21.15.55:0/1563069590 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:20.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9df7fff640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e000b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0491b640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e0015f770 0x7f9e001578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 -- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 msgr2=0x7f9e000b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e000b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 -- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e0015f770 msgr2=0x7f9e001578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e0015f770 0x7f9e001578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 -- 172.21.15.55:0/1563069590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e000b6610 con 0x7f9e00163cb0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9e0511c640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 0x7f9e0006df40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9df802ace0 tx=0x7f9df8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.163+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8040070 con 0x7f9e00163cb0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.164+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df8031bc0 con 0x7f9e00163cb0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.164+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8045460 con 0x7f9e00163cb0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.164+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e000b68f0 con 0x7f9e00163cb0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.164+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e000b6eb0 con 0x7f9e00163cb0 2024-05-10T03:54:20.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.164+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e000b7290 con 0x7f9e00163cb0 2024-05-10T03:54:20.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.165+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9df8039040 con 0x7f9e00163cb0 2024-05-10T03:54:20.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.166+0000 7f9df57fa640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9dec0762d0 0x7f9dec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.166+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f9df80b8ee0 con 0x7f9e00163cb0 2024-05-10T03:54:20.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.166+0000 7f9e0491b640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9dec0762d0 0x7f9dec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.166+0000 7f9e0491b640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9dec0762d0 0x7f9dec078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc006fd0 tx=0x7f9dfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:20.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.170+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e000b7290 con 0x7f9e00163cb0 2024-05-10T03:54:20.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.361+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e00161130 con 0x7f9e00163cb0 2024-05-10T03:54:20.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.362+0000 7f9df57fa640 1 -- 172.21.15.55:0/1563069590 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16586 (secure 0 0 0) 0x7f9df80828d0 con 0x7f9e00163cb0 2024-05-10T03:54:20.365 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:20.365 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:54:19.076365+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:54:17.121690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T03:54:18.026924+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:20.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9dec0762d0 msgr2=0x7f9dec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9dec0762d0 0x7f9dec078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc006fd0 tx=0x7f9dfc008040 comp rx=0 tx=0).stop 2024-05-10T03:54:20.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 msgr2=0x7f9e0006df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 0x7f9e0006df40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9df802ace0 tx=0x7f9df8004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:20.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 shutdown_connections 2024-05-10T03:54:20.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9dec0762d0 0x7f9dec078790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e00163cb0 0x7f9e0006df40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e00163080 0x7f9e000b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 --2- 172.21.15.55:0/1563069590 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e0015f770 0x7f9e001578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 >> 172.21.15.55:0/1563069590 conn(0x7f9e000b4d70 msgr2=0x7f9e0006d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:20.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 shutdown_connections 2024-05-10T03:54:20.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.364+0000 7f9e06b7f640 1 -- 172.21.15.55:0/1563069590 wait complete. 2024-05-10T03:54:20.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T03:54:20.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 Processor -- start 2024-05-10T03:54:20.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 -- start start 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f46c815f5f0 0x7f46c80d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c80d3cc0 con 0x7f46c80d4d60 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f46c80d48d0 con 0x7f46c815f5f0 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46cd9af640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80d3fa0 con 0x7f46c80d37d0 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.483+0000 7f46c77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f46c80d4d60 0x7f46c806d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54298/0 (socket says 172.21.15.55:54298) 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c77fe640 1 -- 172.21.15.55:0/2009282250 learned_addr learned my addr 172.21.15.55:0/2009282250 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c6ffd640 1 --2- 172.21.15.55:0/2009282250 >> v2:172.21.15.64:3300/0 conn(0x7f46c815f5f0 0x7f46c80d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c67fc640 1 --2- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c5ffb640 1 -- 172.21.15.55:0/2009282250 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255229315 0 0) 0x7f46c80d3cc0 con 0x7f46c80d4d60 2024-05-10T03:54:20.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c5ffb640 1 -- 172.21.15.55:0/2009282250 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b4003520 con 0x7f46c80d4d60 2024-05-10T03:54:20.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c5ffb640 1 -- 172.21.15.55:0/2009282250 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584484496 0 0) 0x7f46b4003520 con 0x7f46c80d4d60 2024-05-10T03:54:20.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c6ffd640 1 -- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 msgr2=0x7f46c80b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:20.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c6ffd640 1 --2- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c6ffd640 1 -- 172.21.15.55:0/2009282250 >> v1:172.21.15.55:6789/0 conn(0x7f46c80d4d60 legacy=0x7f46c806d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.484+0000 7f46c6ffd640 1 -- 172.21.15.55:0/2009282250 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c80d4280 con 0x7f46c815f5f0 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.485+0000 7f46c6ffd640 1 --2- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80d3290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46c00097a0 tx=0x7f46c002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2888801090fe2325 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.485+0000 7f46c5ffb640 1 -- 172.21.15.55:0/2009282250 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0037070 con 0x7f46c815f5f0 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.485+0000 7f46c5ffb640 1 -- 172.21.15.55:0/2009282250 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c002aba0 con 0x7f46c815f5f0 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.485+0000 7f46c5ffb640 1 -- 172.21.15.55:0/2009282250 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8001a70 con 0x7f46c815f5f0 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 -- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 msgr2=0x7f46c80d3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 --2- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80d3290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46c00097a0 tx=0x7f46c002a110 comp rx=0 tx=0).stop 2024-05-10T03:54:20.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 -- 172.21.15.55:0/2009282250 shutdown_connections 2024-05-10T03:54:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 --2- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 --2- 172.21.15.55:0/2009282250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80d3290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 -- 172.21.15.55:0/2009282250 >> 172.21.15.55:0/2009282250 conn(0x7f46c80740f0 msgr2=0x7f46c80d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 -- 172.21.15.55:0/2009282250 shutdown_connections 2024-05-10T03:54:20.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.486+0000 7f46cd9af640 1 -- 172.21.15.55:0/2009282250 wait complete. 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.487+0000 7f46cd9af640 1 Processor -- start 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.487+0000 7f46cd9af640 1 -- start start 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46cd9af640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46cd9af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 0x7f46c81f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46cd9af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46cd9af640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80bb1f0 con 0x7f46c80d4d60 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46cd9af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80bb070 con 0x7f46c815f5f0 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46cd9af640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80b7210 con 0x7f46c80d37d0 2024-05-10T03:54:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 0x7f46c81f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 0x7f46c81f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43732/0 (socket says 172.21.15.55:43732) 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 -- 172.21.15.55:0/721464496 learned_addr learned my addr 172.21.15.55:0/721464496 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c6ffd640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c77fe640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 -- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 msgr2=0x7f46c80c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 -- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 msgr2=0x7f46c80cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.488+0000 7f46c67fc640 1 -- 172.21.15.55:0/721464496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c8160bc0 con 0x7f46c80d4d60 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.489+0000 7f46c67fc640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 0x7f46c81f5ff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e8d0 tx=0x7f46b000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.489+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0017070 con 0x7f46c80d4d60 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.489+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b000c940 con 0x7f46c80d4d60 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.489+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c8160ea0 con 0x7f46c80d4d60 2024-05-10T03:54:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.489+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b000cd30 con 0x7f46c80d4d60 2024-05-10T03:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.489+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c80c94f0 con 0x7f46c80d4d60 2024-05-10T03:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.490+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c806a7e0 con 0x7f46c80d4d60 2024-05-10T03:54:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.491+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46b001a070 con 0x7f46c80d4d60 2024-05-10T03:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.491+0000 7f46bffff640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f46a80762d0 0x7f46a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.491+0000 7f46c6ffd640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f46a80762d0 0x7f46a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.491+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f46b0097920 con 0x7f46c80d4d60 2024-05-10T03:54:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.492+0000 7f46c6ffd640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f46a80762d0 0x7f46a8078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46c0034000 tx=0x7f46c002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.496+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f46b0060cc0 con 0x7f46c80d4d60 2024-05-10T03:54:20.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:20.725+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f46c80d5c20 con 0x7f46c80d4d60 2024-05-10T03:54:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.728+0000 7f46bffff640 1 -- 172.21.15.55:0/721464496 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f46b0069300 con 0x7f46c80d4d60 2024-05-10T03:54:21.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f46a80762d0 msgr2=0x7f46a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f46a80762d0 0x7f46a8078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46c0034000 tx=0x7f46c002e000 comp rx=0 tx=0).stop 2024-05-10T03:54:21.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 msgr2=0x7f46c81f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 0x7f46c81f5ff0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e8d0 tx=0x7f46b000ed90 comp rx=0 tx=0).stop 2024-05-10T03:54:21.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 shutdown_connections 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46c815f5f0 0x7f46c80cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f46a80762d0 0x7f46a8078790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46c80d4d60 0x7f46c81f5ff0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 --2- 172.21.15.55:0/721464496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46c80d37d0 0x7f46c80c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.731+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 >> 172.21.15.55:0/721464496 conn(0x7f46c80740f0 msgr2=0x7f46c815e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.732+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 shutdown_connections 2024-05-10T03:54:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.732+0000 7f46cd9af640 1 -- 172.21.15.55:0/721464496 wait complete. 2024-05-10T03:54:21.749 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T03:54:21.749 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T03:54:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.859+0000 7fa4927dd640 1 Processor -- start 2024-05-10T03:54:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.859+0000 7fa4927dd640 1 -- start start 2024-05-10T03:54:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.859+0000 7fa4927dd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 0x7fa48c0d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa4927dd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48c0d3e80 con 0x7fa48c15f2b0 2024-05-10T03:54:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa4927dd640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48c0d4160 con 0x7fa48c0d4f20 2024-05-10T03:54:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa4927dd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa48c0d4440 con 0x7fa48c15f690 2024-05-10T03:54:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa48c15f2b0 0x7fa48c0d3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54300/0 (socket says 172.21.15.55:54300) 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48bfff640 1 -- 172.21.15.55:0/1523563273 learned_addr learned my addr 172.21.15.55:0/1523563273 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568725237 0 0) 0x7fa48c0d3e80 con 0x7fa48c15f2b0 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa474003520 con 0x7fa48c15f2b0 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48b7fe640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 0x7fa48c0d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3364654744 0 0) 0x7fa474003520 con 0x7fa48c15f2b0 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 msgr2=0x7fa48c0d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 0x7fa48c0d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 >> v1:172.21.15.64:6789/0 conn(0x7fa48c0d4f20 legacy=0x7fa48c0b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48c0d4720 con 0x7fa48c15f2b0 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7fa47c0016f0 con 0x7fa48c15f2b0 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 >> v1:172.21.15.55:6789/0 conn(0x7fa48c15f2b0 legacy=0x7fa48c0d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 0x7fa474003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa474004050 0x7fa474004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa4740051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c0d4440 con 0x7fa474004d40 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa47400bbb0 con 0x7fa474004050 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.860+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa47400bdb0 con 0x7fa48c15f690 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa490d7a640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa4740051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa48b7fe640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa474004050 0x7fa474004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa48bfff640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 0x7fa474003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa490d7a640 1 -- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 msgr2=0x7fa474003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa490d7a640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c15f690 0x7fa474003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa490d7a640 1 -- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa474004050 msgr2=0x7fa474004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa490d7a640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa474004050 0x7fa474004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.861+0000 7fa490d7a640 1 -- 172.21.15.55:0/1523563273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa474003520 con 0x7fa474004d40 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa490d7a640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa4740051a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa484001e90 tx=0x7fa474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129cc5ee1a9a558a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484001ab0 con 0x7fa474004d40 2024-05-10T03:54:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48402ae50 con 0x7fa474004d40 2024-05-10T03:54:21.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa48affd640 1 -- 172.21.15.55:0/1523563273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484003b70 con 0x7fa474004d40 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa4927dd640 1 -- 172.21.15.55:0/1523563273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 msgr2=0x7fa4740051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa4927dd640 1 --2- 172.21.15.55:0/1523563273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa4740051a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa484001e90 tx=0x7fa474005830 comp rx=0 tx=0).stop 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa490d7a640 1 -- 172.21.15.55:0/1523563273 reap_dead start 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa4927dd640 1 -- 172.21.15.55:0/1523563273 shutdown_connections 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa4927dd640 1 -- 172.21.15.55:0/1523563273 >> 172.21.15.55:0/1523563273 conn(0x7fa48c0740f0 msgr2=0x7fa48c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa4927dd640 1 -- 172.21.15.55:0/1523563273 shutdown_connections 2024-05-10T03:54:21.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.862+0000 7fa4927dd640 1 -- 172.21.15.55:0/1523563273 wait complete. 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.864+0000 7fa4927dd640 1 Processor -- start 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.864+0000 7fa4927dd640 1 -- start start 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.864+0000 7fa4927dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa48c0cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c156a40 0x7fa48c1f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c0b8f70 0x7fa48c0b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c0bb230 con 0x7fa474004d40 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c0d3b30 con 0x7fa48c156a40 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa48c0b8b90 con 0x7fa48c0b8f70 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa48c0cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa48c0cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43754/0 (socket says 172.21.15.55:43754) 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 -- 172.21.15.55:0/2120305161 learned_addr learned my addr 172.21.15.55:0/2120305161 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 -- 172.21.15.55:0/2120305161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c0b8f70 msgr2=0x7fa48c0b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c0b8f70 0x7fa48c0b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 -- 172.21.15.55:0/2120305161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c156a40 msgr2=0x7fa48c1f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:21.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c156a40 0x7fa48c1f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 -- 172.21.15.55:0/2120305161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48c15fde0 con 0x7fa474004d40 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa48bfff640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa48c0cf060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa47c007320 tx=0x7fa47c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c01a070 con 0x7fa474004d40 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c00f960 con 0x7fa474004d40 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00fd30 con 0x7fa474004d40 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48c1600c0 con 0x7fa474004d40 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.865+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48c160680 con 0x7fa474004d40 2024-05-10T03:54:21.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.866+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa48c0b9930 con 0x7fa474004d40 2024-05-10T03:54:21.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.867+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa47c01d360 con 0x7fa474004d40 2024-05-10T03:54:21.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.867+0000 7fa488ff9640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa478076300 0x7fa4780787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:21.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.868+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa47c096ea0 con 0x7fa474004d40 2024-05-10T03:54:21.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.868+0000 7fa48b7fe640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa478076300 0x7fa4780787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:21.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.868+0000 7fa48b7fe640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa478076300 0x7fa4780787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0ba610 tx=0x7fa4800095d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:21.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:21.872+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa47c060760 con 0x7fa474004d40 2024-05-10T03:54:22.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.103+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa48c06a7e0 con 0x7fa474004d40 2024-05-10T03:54:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.740+0000 7fa488ff9640 1 -- 172.21.15.55:0/2120305161 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fa47c060060 con 0x7fa474004d40 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa478076300 msgr2=0x7fa4780787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa478076300 0x7fa4780787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0ba610 tx=0x7fa4800095d0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 msgr2=0x7fa48c0cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa48c0cf060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa47c007320 tx=0x7fa47c0077e0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 shutdown_connections 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa48c0b8f70 0x7fa48c0b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa48c156a40 0x7fa48c1f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa478076300 0x7fa4780787c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 --2- 172.21.15.55:0/2120305161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa474004d40 0x7fa48c0cf060 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 >> 172.21.15.55:0/2120305161 conn(0x7fa48c0740f0 msgr2=0x7fa48c0d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 shutdown_connections 2024-05-10T03:54:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.743+0000 7fa4927dd640 1 -- 172.21.15.55:0/2120305161 wait complete. 2024-05-10T03:54:22.760 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T03:54:22.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:22.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.867+0000 7f20d7d6a640 1 Processor -- start 2024-05-10T03:54:22.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.867+0000 7f20d7d6a640 1 -- start start 2024-05-10T03:54:22.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d7d6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d00d3360 0x7f20d00d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:22.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d7d6a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f20d00d3de0 0x7f20d00b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:22.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d7d6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00d2b50 con 0x7f20d015f3d0 2024-05-10T03:54:22.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d7d6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f20d00d4210 con 0x7f20d00d3360 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d7d6a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f20d0160a10 con 0x7f20d00d3de0 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d5305640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d00d3360 0x7f20d00d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d5b06640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f20d015f3d0 0x7f20d00d2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54308/0 (socket says 172.21.15.55:54308) 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.868+0000 7f20d5b06640 1 -- 172.21.15.55:0/2449358520 learned_addr learned my addr 172.21.15.55:0/2449358520 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.869+0000 7f20d6307640 1 --2- 172.21.15.55:0/2449358520 >> v2:172.21.15.64:3300/0 conn(0x7f20d00d3de0 0x7f20d00b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.869+0000 7f20d5305640 1 -- 172.21.15.55:0/2449358520 >> v2:172.21.15.64:3300/0 conn(0x7f20d00d3de0 msgr2=0x7f20d00b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.869+0000 7f20d5305640 1 --2- 172.21.15.55:0/2449358520 >> v2:172.21.15.64:3300/0 conn(0x7f20d00d3de0 0x7f20d00b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.869+0000 7f20d5305640 1 -- 172.21.15.55:0/2449358520 >> v1:172.21.15.55:6789/0 conn(0x7f20d015f3d0 legacy=0x7f20d00d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.869+0000 7f20d5305640 1 -- 172.21.15.55:0/2449358520 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d0160450 con 0x7f20d00d3360 2024-05-10T03:54:22.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.869+0000 7f20d4b04640 1 -- 172.21.15.55:0/2449358520 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489654734 0 0) 0x7f20d00d2b50 con 0x7f20d015f3d0 2024-05-10T03:54:22.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d5305640 1 --2- 172.21.15.55:0/2449358520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d00d38a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f20d00c8d40 tx=0x7f20c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4319b85590a297 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d4b04640 1 -- 172.21.15.55:0/2449358520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4037070 con 0x7f20d00d3360 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d4b04640 1 -- 172.21.15.55:0/2449358520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c4032440 con 0x7f20d00d3360 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d4b04640 1 -- 172.21.15.55:0/2449358520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4032810 con 0x7f20d00d3360 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 -- 172.21.15.55:0/2449358520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 msgr2=0x7f20d00d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/2449358520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d00d38a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f20d00c8d40 tx=0x7f20c402a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 -- 172.21.15.55:0/2449358520 shutdown_connections 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/2449358520 >> v2:172.21.15.64:3300/0 conn(0x7f20d00d3de0 0x7f20d00b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/2449358520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d00d38a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 -- 172.21.15.55:0/2449358520 >> 172.21.15.55:0/2449358520 conn(0x7f20d008ed00 msgr2=0x7f20d009e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 -- 172.21.15.55:0/2449358520 shutdown_connections 2024-05-10T03:54:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.870+0000 7f20d7d6a640 1 -- 172.21.15.55:0/2449358520 wait complete. 2024-05-10T03:54:22.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 Processor -- start 2024-05-10T03:54:22.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 -- start start 2024-05-10T03:54:22.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d01f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:22.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20d00d3de0 0x7f20d0154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:22.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f20d015f3d0 0x7f20d00b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00d1f20 con 0x7f20d00d3360 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00d1c40 con 0x7f20d00d3de0 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d7d6a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f20d00b54a0 con 0x7f20d015f3d0 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.872+0000 7f20d5b06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d01f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d01f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43772/0 (socket says 172.21.15.55:43772) 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 -- 172.21.15.55:0/302474955 learned_addr learned my addr 172.21.15.55:0/302474955 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 -- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f20d015f3d0 msgr2=0x7f20d00b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d6307640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f20d015f3d0 0x7f20d00b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5305640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20d00d3de0 0x7f20d0154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f20d015f3d0 0x7f20d00b9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 -- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20d00d3de0 msgr2=0x7f20d0154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20d00d3de0 0x7f20d0154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:22.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 -- 172.21.15.55:0/302474955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d01f60b0 con 0x7f20d00d3360 2024-05-10T03:54:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d5b06640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d01f71c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c3e0 tx=0x7f20c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c80074e0 con 0x7f20d00d3360 2024-05-10T03:54:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c80047e0 con 0x7f20d00d3360 2024-05-10T03:54:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d01f6390 con 0x7f20d00d3360 2024-05-10T03:54:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8004bd0 con 0x7f20d00d3360 2024-05-10T03:54:22.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.873+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d01f6950 con 0x7f20d00d3360 2024-05-10T03:54:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.874+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d0162ba0 con 0x7f20d00d3360 2024-05-10T03:54:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.875+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f20c8011070 con 0x7f20d00d3360 2024-05-10T03:54:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.875+0000 7f20ce7fc640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f20bc0762d0 0x7f20bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.876+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f20c80972d0 con 0x7f20d00d3360 2024-05-10T03:54:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.876+0000 7f20d5305640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f20bc0762d0 0x7f20bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:22.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.876+0000 7f20d5305640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f20bc0762d0 0x7f20bc078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20c4034000 tx=0x7f20c402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:22.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:22.880+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f20d0162ba0 con 0x7f20d00d3360 2024-05-10T03:54:23.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.108+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20d0068cb0 con 0x7f20d00d3360 2024-05-10T03:54:23.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.109+0000 7f20ce7fc640 1 -- 172.21.15.55:0/302474955 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5175 (secure 0 0 0) 0x7f20d0068cb0 con 0x7f20d00d3360 2024-05-10T03:54:23.113 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:23.113 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:22.105637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4800":{"gid":4800,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1112724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1112724499},{"type":"v1","addr":"172.21.15.55:6836","nonce":1112724499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4800,"qdb_cluster":[4800]},"id":2}]} 2024-05-10T03:54:23.113 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-05-10T03:54:23.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f20bc0762d0 msgr2=0x7f20bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f20bc0762d0 0x7f20bc078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20c4034000 tx=0x7f20c402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 msgr2=0x7f20d01f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d01f71c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c3e0 tx=0x7f20c800c8a0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 shutdown_connections 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f20d015f3d0 0x7f20d00b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f20d00d3de0 0x7f20d0154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f20bc0762d0 0x7f20bc078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 --2- 172.21.15.55:0/302474955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d00d3360 0x7f20d01f71c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 >> 172.21.15.55:0/302474955 conn(0x7f20d008ed00 msgr2=0x7f20d015f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 shutdown_connections 2024-05-10T03:54:23.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.111+0000 7f20d7d6a640 1 -- 172.21.15.55:0/302474955 wait complete. 2024-05-10T03:54:23.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:23.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.226+0000 7fccc80f8640 1 Processor -- start 2024-05-10T03:54:23.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.226+0000 7fccc80f8640 1 -- start start 2024-05-10T03:54:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc80f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccc0163080 0x7fccc0163460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc80f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163cb0 0x7fccc00d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc80f8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc01639a0 con 0x7fccc00cdf70 2024-05-10T03:54:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc80f8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fccc009ba60 con 0x7fccc0163080 2024-05-10T03:54:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc80f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fccc009bcb0 con 0x7fccc0163cb0 2024-05-10T03:54:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc5e94640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccc0163080 0x7fccc0163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc6695640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fccc00cdf70 0x7fccc00ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54324/0 (socket says 172.21.15.55:54324) 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc6695640 1 -- 172.21.15.55:0/4115041608 learned_addr learned my addr 172.21.15.55:0/4115041608 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc5693640 1 --2- 172.21.15.55:0/4115041608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163cb0 0x7fccc00d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc5e94640 1 -- 172.21.15.55:0/4115041608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163cb0 msgr2=0x7fccc00d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc5e94640 1 --2- 172.21.15.55:0/4115041608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163cb0 0x7fccc00d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.227+0000 7fccc5e94640 1 -- 172.21.15.55:0/4115041608 >> v1:172.21.15.55:6789/0 conn(0x7fccc00cdf70 legacy=0x7fccc00ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.228+0000 7fccc4e92640 1 -- 172.21.15.55:0/4115041608 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482621135 0 0) 0x7fccc01639a0 con 0x7fccc00cdf70 2024-05-10T03:54:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.228+0000 7fccc5e94640 1 -- 172.21.15.55:0/4115041608 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc009bf90 con 0x7fccc0163080 2024-05-10T03:54:23.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.228+0000 7fccc5e94640 1 --2- 172.21.15.55:0/4115041608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163080 0x7fccc0163460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0097a0 tx=0x7fccbc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcca49ec1655121 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.228+0000 7fccc4e92640 1 -- 172.21.15.55:0/4115041608 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc037070 con 0x7fccc0163080 2024-05-10T03:54:23.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.228+0000 7fccc4e92640 1 -- 172.21.15.55:0/4115041608 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc032440 con 0x7fccc0163080 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.228+0000 7fccc4e92640 1 -- 172.21.15.55:0/4115041608 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc032810 con 0x7fccc0163080 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 -- 172.21.15.55:0/4115041608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163080 msgr2=0x7fccc0163460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 --2- 172.21.15.55:0/4115041608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163080 0x7fccc0163460 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0097a0 tx=0x7fccbc02a210 comp rx=0 tx=0).stop 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 -- 172.21.15.55:0/4115041608 shutdown_connections 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 --2- 172.21.15.55:0/4115041608 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163cb0 0x7fccc00d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 --2- 172.21.15.55:0/4115041608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163080 0x7fccc0163460 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 -- 172.21.15.55:0/4115041608 >> 172.21.15.55:0/4115041608 conn(0x7fccc00b4d70 msgr2=0x7fccc00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 -- 172.21.15.55:0/4115041608 shutdown_connections 2024-05-10T03:54:23.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.229+0000 7fccc80f8640 1 -- 172.21.15.55:0/4115041608 wait complete. 2024-05-10T03:54:23.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.230+0000 7fccc80f8640 1 Processor -- start 2024-05-10T03:54:23.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.230+0000 7fccc80f8640 1 -- start start 2024-05-10T03:54:23.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc80f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccc00cdf70 0x7fccc00cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc80f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163080 0x7fccc015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc80f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 0x7fccc00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc80f8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fccc009c830 con 0x7fccc0163cb0 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc80f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fccc009c550 con 0x7fccc00cdf70 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc80f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fccc00d2250 con 0x7fccc0163080 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 0x7fccc00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 0x7fccc00ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43794/0 (socket says 172.21.15.55:43794) 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 -- 172.21.15.55:0/2081174657 learned_addr learned my addr 172.21.15.55:0/2081174657 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc5693640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163080 0x7fccc015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc5e94640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccc00cdf70 0x7fccc00cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 -- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163080 msgr2=0x7fccc015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163080 0x7fccc015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 -- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccc00cdf70 msgr2=0x7fccc00cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.231+0000 7fccc6695640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccc00cdf70 0x7fccc00cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccc6695640 1 -- 172.21.15.55:0/2081174657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc015add0 con 0x7fccc0163cb0 2024-05-10T03:54:23.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccc6695640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 0x7fccc00ccbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c790 tx=0x7fccb800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8018070 con 0x7fccc0163cb0 2024-05-10T03:54:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb800a640 con 0x7fccc0163cb0 2024-05-10T03:54:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc015fb50 con 0x7fccc0163cb0 2024-05-10T03:54:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb800aa50 con 0x7fccc0163cb0 2024-05-10T03:54:23.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.232+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc00cb460 con 0x7fccc0163cb0 2024-05-10T03:54:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.233+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc00a1390 con 0x7fccc0163cb0 2024-05-10T03:54:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.234+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccb801b070 con 0x7fccc0163cb0 2024-05-10T03:54:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.234+0000 7fccb67fc640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcca4076300 0x7fcca40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.234+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fccb8096a60 con 0x7fccc0163cb0 2024-05-10T03:54:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.234+0000 7fccc5e94640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcca4076300 0x7fcca40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.235+0000 7fccc5e94640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcca4076300 0x7fcca40787c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fccbc034000 tx=0x7fccbc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.239+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fccc015add0 con 0x7fccc0163cb0 2024-05-10T03:54:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.431+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccc0050820 con 0x7fccc0163cb0 2024-05-10T03:54:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.432+0000 7fccb67fc640 1 -- 172.21.15.55:0/2081174657 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16573 (secure 0 0 0) 0x7fccb805fe00 con 0x7fccc0163cb0 2024-05-10T03:54:23.436 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:23.436 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":31,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:54:20.709291+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:54:17.121690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T03:54:18.026924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcca4076300 msgr2=0x7fcca40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcca4076300 0x7fcca40787c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fccbc034000 tx=0x7fccbc02e000 comp rx=0 tx=0).stop 2024-05-10T03:54:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 msgr2=0x7fccc00ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 0x7fccc00ccbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c790 tx=0x7fccb800cc50 comp rx=0 tx=0).stop 2024-05-10T03:54:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 shutdown_connections 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcca4076300 0x7fcca40787c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccc0163cb0 0x7fccc00ccbd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fccc0163080 0x7fccc015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 --2- 172.21.15.55:0/2081174657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fccc00cdf70 0x7fccc00cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 >> 172.21.15.55:0/2081174657 conn(0x7fccc00b4d70 msgr2=0x7fccc00b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 shutdown_connections 2024-05-10T03:54:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.434+0000 7fccc80f8640 1 -- 172.21.15.55:0/2081174657 wait complete. 2024-05-10T03:54:23.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T03:54:23.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:54:23.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.549+0000 7fcedcfaf640 1 Processor -- start 2024-05-10T03:54:23.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.549+0000 7fcedcfaf640 1 -- start start 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.550+0000 7fcedcfaf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced815f3d0 0x7fced80d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.550+0000 7fcedcfaf640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fced80d2980 0x7fced80d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.550+0000 7fcedcfaf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced8160a10 con 0x7fced80d3360 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.550+0000 7fcedcfaf640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fced8160450 con 0x7fced80d2980 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.550+0000 7fcedcfaf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fced8160730 con 0x7fced815f3d0 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fced80d3360 0x7fced80b4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54328/0 (socket says 172.21.15.55:54328) 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced6d9d640 1 -- 172.21.15.55:0/2084215530 learned_addr learned my addr 172.21.15.55:0/2084215530 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced659c640 1 --2- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced815f3d0 0x7fced80d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced5d9b640 1 --2- 172.21.15.55:0/2084215530 >> v2:172.21.15.64:3300/0 conn(0x7fced80d2980 0x7fced80d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced559a640 1 -- 172.21.15.55:0/2084215530 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251619323 0 0) 0x7fced8160a10 con 0x7fced80d3360 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced559a640 1 -- 172.21.15.55:0/2084215530 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcec4003520 con 0x7fced80d3360 2024-05-10T03:54:23.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced5d9b640 1 -- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced815f3d0 msgr2=0x7fced80d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:23.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced5d9b640 1 --2- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced815f3d0 0x7fced80d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced5d9b640 1 -- 172.21.15.55:0/2084215530 >> v1:172.21.15.55:6789/0 conn(0x7fced80d3360 legacy=0x7fced80b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.551+0000 7fced5d9b640 1 -- 172.21.15.55:0/2084215530 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced80d1c40 con 0x7fced80d2980 2024-05-10T03:54:23.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.552+0000 7fced5d9b640 1 --2- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80d2980 0x7fced80d38a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097a0 tx=0x7fcec002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd763fee86e8fa18 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.552+0000 7fced559a640 1 -- 172.21.15.55:0/2084215530 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0037070 con 0x7fced80d2980 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.552+0000 7fced559a640 1 -- 172.21.15.55:0/2084215530 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec002ae50 con 0x7fced80d2980 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.552+0000 7fced559a640 1 -- 172.21.15.55:0/2084215530 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0032640 con 0x7fced80d2980 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 -- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80d2980 msgr2=0x7fced80d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80d2980 0x7fced80d38a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097a0 tx=0x7fcec002a100 comp rx=0 tx=0).stop 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 -- 172.21.15.55:0/2084215530 shutdown_connections 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80d2980 0x7fced80d38a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/2084215530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced815f3d0 0x7fced80d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 -- 172.21.15.55:0/2084215530 >> 172.21.15.55:0/2084215530 conn(0x7fced808ed00 msgr2=0x7fced809e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 -- 172.21.15.55:0/2084215530 shutdown_connections 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.553+0000 7fcedcfaf640 1 -- 172.21.15.55:0/2084215530 wait complete. 2024-05-10T03:54:23.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.554+0000 7fcedcfaf640 1 Processor -- start 2024-05-10T03:54:23.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.554+0000 7fcedcfaf640 1 -- start start 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fcedcfaf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced80d3360 0x7fced80c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fcedcfaf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 0x7fced8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fcedcfaf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80cb500 0x7fced80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fcedcfaf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fced80b57f0 con 0x7fced815f3d0 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fcedcfaf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fced80b5670 con 0x7fced80cb500 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fcedcfaf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fced80cbc90 con 0x7fced80d3360 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 0x7fced8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 0x7fced8153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43810/0 (socket says 172.21.15.55:43810) 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 -- 172.21.15.55:0/3775025859 learned_addr learned my addr 172.21.15.55:0/3775025859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced659c640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced80d3360 0x7fced80c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 -- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced80d3360 msgr2=0x7fced80c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced80d3360 0x7fced80c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced6d9d640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80cb500 0x7fced80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 -- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80cb500 msgr2=0x7fced80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80cb500 0x7fced80ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 -- 172.21.15.55:0/3775025859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced80cb9b0 con 0x7fced815f3d0 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced6d9d640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80cb500 0x7fced80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.555+0000 7fced5d9b640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 0x7fced8153860 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097a0 tx=0x7fcec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.556+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0037040 con 0x7fced815f3d0 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.556+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcec0004030 con 0x7fced815f3d0 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.556+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced80cda20 con 0x7fced815f3d0 2024-05-10T03:54:23.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.556+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0006e10 con 0x7fced815f3d0 2024-05-10T03:54:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.556+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced80cdfe0 con 0x7fced815f3d0 2024-05-10T03:54:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.557+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced80a3290 con 0x7fced815f3d0 2024-05-10T03:54:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.557+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcec0003610 con 0x7fced815f3d0 2024-05-10T03:54:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.558+0000 7fceceffd640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fceb80762d0 0x7fceb8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.558+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fcec00b8110 con 0x7fced815f3d0 2024-05-10T03:54:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.558+0000 7fced659c640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fceb80762d0 0x7fceb8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.558+0000 7fced659c640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fceb80762d0 0x7fceb8078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fced815cad0 tx=0x7fced0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.562+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcec004c070 con 0x7fced815f3d0 2024-05-10T03:54:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.749+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fced80b67f0 con 0x7fceb80762d0 2024-05-10T03:54:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.755+0000 7fceceffd640 1 -- 172.21.15.55:0/3775025859 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239845 (secure 0 0 0) 0x7fced80b67f0 con 0x7fceb80762d0 2024-05-10T03:54:23.761 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:23.762 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:54:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fceb80762d0 msgr2=0x7fceb8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fceb80762d0 0x7fceb8078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fced815cad0 tx=0x7fced0008040 comp rx=0 tx=0).stop 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 msgr2=0x7fced8153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 0x7fced8153860 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcec00097a0 tx=0x7fcec00046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 shutdown_connections 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fced80cb500 0x7fced80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fceb80762d0 0x7fceb8078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fced815f3d0 0x7fced8153860 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 --2- 172.21.15.55:0/3775025859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fced80d3360 0x7fced80c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 >> 172.21.15.55:0/3775025859 conn(0x7fced808ed00 msgr2=0x7fced815e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 shutdown_connections 2024-05-10T03:54:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.758+0000 7fcedcfaf640 1 -- 172.21.15.55:0/3775025859 wait complete. 2024-05-10T03:54:23.773 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-10T03:54:21.789403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3520,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3604480,"data_stored":2061018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.106054"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.689666+0000","last_change":"2024-05-10T03:54:17.689666+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.689666+0000","last_undegraded":"2024-05-10T03:54:17.689666+0000","last_fullsized":"2024-05-10T03:54:17.689666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.688698+0000","last_change":"2024-05-10T03:54:17.688698+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.688698+0000","last_undegraded":"2024-05-10T03:54:17.688698+0000","last_fullsized":"2024-05-10T03:54:17.688698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.690622+0000","last_change":"2024-05-10T03:54:17.690622+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.690622+0000","last_undegraded":"2024-05-10T03:54:17.690622+0000","last_fullsized":"2024-05-10T03:54:17.690622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.689107+0000","last_change":"2024-05-10T03:54:17.689107+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.689107+0000","last_undegraded":"2024-05-10T03:54:17.689107+0000","last_fullsized":"2024-05-10T03:54:17.689107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686642+0000","last_change":"2024-05-10T03:54:17.686642+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686642+0000","last_undegraded":"2024-05-10T03:54:17.686642+0000","last_fullsized":"2024-05-10T03:54:17.686642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.687194+0000","last_change":"2024-05-10T03:54:17.687194+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.687194+0000","last_undegraded":"2024-05-10T03:54:17.687194+0000","last_fullsized":"2024-05-10T03:54:17.687194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.691045+0000","last_change":"2024-05-10T03:54:17.691045+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.691045+0000","last_undegraded":"2024-05-10T03:54:17.691045+0000","last_fullsized":"2024-05-10T03:54:17.691045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686063+0000","last_change":"2024-05-10T03:54:17.686063+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686063+0000","last_undegraded":"2024-05-10T03:54:17.686063+0000","last_fullsized":"2024-05-10T03:54:17.686063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.691130+0000","last_change":"2024-05-10T03:54:17.691130+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.691130+0000","last_undegraded":"2024-05-10T03:54:17.691130+0000","last_fullsized":"2024-05-10T03:54:17.691130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.688170+0000","last_change":"2024-05-10T03:54:17.688170+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.688170+0000","last_undegraded":"2024-05-10T03:54:17.688170+0000","last_fullsized":"2024-05-10T03:54:17.688170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686077+0000","last_change":"2024-05-10T03:54:17.686077+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686077+0000","last_undegraded":"2024-05-10T03:54:17.686077+0000","last_fullsized":"2024-05-10T03:54:17.686077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.690826+0000","last_change":"2024-05-10T03:54:17.690826+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.690826+0000","last_undegraded":"2024-05-10T03:54:17.690826+0000","last_fullsized":"2024-05-10T03:54:17.690826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686057+0000","last_change":"2024-05-10T03:54:17.686057+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686057+0000","last_undegraded":"2024-05-10T03:54:17.686057+0000","last_fullsized":"2024-05-10T03:54:17.686057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.692097+0000","last_change":"2024-05-10T03:54:17.692097+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.692097+0000","last_undegraded":"2024-05-10T03:54:17.692097+0000","last_fullsized":"2024-05-10T03:54:17.692097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.690475+0000","last_change":"2024-05-10T03:54:17.690475+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.690475+0000","last_undegraded":"2024-05-10T03:54:17.690475+0000","last_fullsized":"2024-05-10T03:54:17.690475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.691055+0000","last_change":"2024-05-10T03:54:17.691055+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.691055+0000","last_undegraded":"2024-05-10T03:54:17.691055+0000","last_fullsized":"2024-05-10T03:54:17.691055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.692867+0000","last_change":"2024-05-10T03:54:17.692867+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.692867+0000","last_undegraded":"2024-05-10T03:54:17.692867+0000","last_fullsized":"2024-05-10T03:54:17.692867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686831+0000","last_change":"2024-05-10T03:54:17.686831+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686831+0000","last_undegraded":"2024-05-10T03:54:17.686831+0000","last_fullsized":"2024-05-10T03:54:17.686831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686213+0000","last_change":"2024-05-10T03:54:17.686213+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686213+0000","last_undegraded":"2024-05-10T03:54:17.686213+0000","last_fullsized":"2024-05-10T03:54:17.686213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.687954+0000","last_change":"2024-05-10T03:54:17.687954+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.687954+0000","last_undegraded":"2024-05-10T03:54:17.687954+0000","last_fullsized":"2024-05-10T03:54:17.687954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.687796+0000","last_change":"2024-05-10T03:54:17.687796+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.687796+0000","last_undegraded":"2024-05-10T03:54:17.687796+0000","last_fullsized":"2024-05-10T03:54:17.687796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.689666+0000","last_change":"2024-05-10T03:54:17.689666+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.689666+0000","last_undegraded":"2024-05-10T03:54:17.689666+0000","last_fullsized":"2024-05-10T03:54:17.689666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.687225+0000","last_change":"2024-05-10T03:54:17.687225+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.687225+0000","last_undegraded":"2024-05-10T03:54:17.687225+0000","last_fullsized":"2024-05-10T03:54:17.687225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686462+0000","last_change":"2024-05-10T03:54:17.686462+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686462+0000","last_undegraded":"2024-05-10T03:54:17.686462+0000","last_fullsized":"2024-05-10T03:54:17.686462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.691772+0000","last_change":"2024-05-10T03:54:17.691772+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.691772+0000","last_undegraded":"2024-05-10T03:54:17.691772+0000","last_fullsized":"2024-05-10T03:54:17.691772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.685958+0000","last_change":"2024-05-10T03:54:17.685958+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.685958+0000","last_undegraded":"2024-05-10T03:54:17.685958+0000","last_fullsized":"2024-05-10T03:54:17.685958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.691943+0000","last_change":"2024-05-10T03:54:17.691943+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.691943+0000","last_undegraded":"2024-05-10T03:54:17.691943+0000","last_fullsized":"2024-05-10T03:54:17.691943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.685930+0000","last_change":"2024-05-10T03:54:17.685930+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.685930+0000","last_undegraded":"2024-05-10T03:54:17.685930+0000","last_fullsized":"2024-05-10T03:54:17.685930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.691606+0000","last_change":"2024-05-10T03:54:17.691606+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.691606+0000","last_undegraded":"2024-05-10T03:54:17.691606+0000","last_fullsized":"2024-05-10T03:54:17.691606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.686065+0000","last_change":"2024-05-10T03:54:17.686065+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.686065+0000","last_undegraded":"2024-05-10T03:54:17.686065+0000","last_fullsized":"2024-05-10T03:54:17.686065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.690426+0000","last_change":"2024-05-10T03:54:17.690426+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.690426+0000","last_undegraded":"2024-05-10T03:54:17.690426+0000","last_fullsized":"2024-05-10T03:54:17.690426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-10T03:54:18.683195+0000","last_change":"2024-05-10T03:54:18.683195+0000","last_active":"2024-05-10T03:54:18.683195+0000","last_peered":"2024-05-10T03:54:18.683195+0000","last_clean":"2024-05-10T03:54:18.683195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:18.683195+0000","last_undegraded":"2024-05-10T03:54:18.683195+0000","last_fullsized":"2024-05-10T03:54:18.683195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-05-10T03:54:17.689676+0000","last_change":"2024-05-10T03:54:17.689676+0000","last_active":"2024-05-10T03:54:17.673534+0000","last_peered":"2024-05-10T03:54:17.673534+0000","last_clean":"2024-05-10T03:54:17.673534+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-10T03:54:17.689676+0000","last_undegraded":"2024-05-10T03:54:17.689676+0000","last_fullsized":"2024-05-10T03:54:17.689676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":120,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T03:54:17.688577+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:54:17.688577+0000","last_peered":"2024-05-10T03:54:17.688577+0000","last_clean":"2024-05-10T03:54:17.688577+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:17.688577+0000","last_undegraded":"2024-05-10T03:54:17.688577+0000","last_fullsized":"2024-05-10T03:54:17.688577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":698949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":108581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":108581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":108581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":114398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":698949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:54:23.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:54:23.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.913+0000 7fbafcbaf640 1 Processor -- start 2024-05-10T03:54:23.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.914+0000 7fbafcbaf640 1 -- start start 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.914+0000 7fbafcbaf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf815b880 0x7fbaf80b6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.914+0000 7fbafcbaf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbaf8073ab0 0x7fbaf8073f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.914+0000 7fbafcbaf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf8074480 con 0x7fbaf8141c50 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.914+0000 7fbafcbaf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf8072cf0 con 0x7fbaf8073ab0 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.914+0000 7fbafcbaf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf8072fd0 con 0x7fbaf815b880 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbaf8073ab0 0x7fbaf8073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf5d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbaf8141c50 0x7fbaf80cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54330/0 (socket says 172.21.15.55:54330) 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf5d9b640 1 -- 172.21.15.55:0/1538218095 learned_addr learned my addr 172.21.15.55:0/1538218095 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf6d9d640 1 -- 172.21.15.55:0/1538218095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf815b880 msgr2=0x7fbaf80b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf659c640 1 --2- 172.21.15.55:0/1538218095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf815b880 0x7fbaf80b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf6d9d640 1 --2- 172.21.15.55:0/1538218095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf815b880 0x7fbaf80b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf6d9d640 1 -- 172.21.15.55:0/1538218095 >> v1:172.21.15.55:6789/0 conn(0x7fbaf8141c50 legacy=0x7fbaf80cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf559a640 1 -- 172.21.15.55:0/1538218095 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294102692 0 0) 0x7fbaf8074480 con 0x7fbaf8141c50 2024-05-10T03:54:23.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.915+0000 7fbaf6d9d640 1 -- 172.21.15.55:0/1538218095 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf80732b0 con 0x7fbaf8073ab0 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.916+0000 7fbaf6d9d640 1 --2- 172.21.15.55:0/1538218095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8073ab0 0x7fbaf8073f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbae800a940 tx=0x7fbae802b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf8d7e50c6a4e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.916+0000 7fbaf559a640 1 -- 172.21.15.55:0/1538218095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae800b040 con 0x7fbaf8073ab0 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.916+0000 7fbaf559a640 1 -- 172.21.15.55:0/1538218095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae8030710 con 0x7fbaf8073ab0 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.916+0000 7fbaf559a640 1 -- 172.21.15.55:0/1538218095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8030ae0 con 0x7fbaf8073ab0 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.916+0000 7fbafcbaf640 1 -- 172.21.15.55:0/1538218095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8073ab0 msgr2=0x7fbaf8073f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.916+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/1538218095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8073ab0 0x7fbaf8073f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbae800a940 tx=0x7fbae802b550 comp rx=0 tx=0).stop 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.917+0000 7fbafcbaf640 1 -- 172.21.15.55:0/1538218095 shutdown_connections 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.917+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/1538218095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8073ab0 0x7fbaf8073f40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.917+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/1538218095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf815b880 0x7fbaf80b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.917+0000 7fbafcbaf640 1 -- 172.21.15.55:0/1538218095 >> 172.21.15.55:0/1538218095 conn(0x7fbaf80b2cc0 msgr2=0x7fbaf80b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.917+0000 7fbafcbaf640 1 -- 172.21.15.55:0/1538218095 shutdown_connections 2024-05-10T03:54:23.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.917+0000 7fbafcbaf640 1 -- 172.21.15.55:0/1538218095 wait complete. 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.918+0000 7fbafcbaf640 1 Processor -- start 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.918+0000 7fbafcbaf640 1 -- start start 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbafcbaf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf8073ab0 0x7fbaf80afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbafcbaf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 0x7fbaf80ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbafcbaf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbaf815b880 0x7fbaf80b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbafcbaf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf80cf850 con 0x7fbaf8141c50 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbafcbaf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf80b6e60 con 0x7fbaf815b880 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbafcbaf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf80722c0 con 0x7fbaf8073ab0 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 0x7fbaf80ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 0x7fbaf80ab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43828/0 (socket says 172.21.15.55:43828) 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 -- 172.21.15.55:0/3032800873 learned_addr learned my addr 172.21.15.55:0/3032800873 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf659c640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf8073ab0 0x7fbaf80afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf6d9d640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbaf815b880 0x7fbaf80b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 -- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf8073ab0 msgr2=0x7fbaf80afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf8073ab0 0x7fbaf80afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 -- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbaf815b880 msgr2=0x7fbaf80b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbaf815b880 0x7fbaf80b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 -- 172.21.15.55:0/3032800873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf80b0320 con 0x7fbaf8141c50 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf6d9d640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbaf815b880 0x7fbaf80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaf5d9b640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 0x7fbaf80ab850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c490 tx=0x7fbae000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00074e0 con 0x7fbaf8141c50 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.919+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae00047e0 con 0x7fbaf8141c50 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.920+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf80cb2c0 con 0x7fbaf8141c50 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.920+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0004bd0 con 0x7fbaf8141c50 2024-05-10T03:54:23.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.920+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf80aad70 con 0x7fbaf8141c50 2024-05-10T03:54:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.921+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf8050820 con 0x7fbaf8141c50 2024-05-10T03:54:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.921+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbae0011070 con 0x7fbaf8141c50 2024-05-10T03:54:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.922+0000 7fbaeeffd640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbad80762d0 0x7fbad8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:23.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.922+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbae0097180 con 0x7fbaf8141c50 2024-05-10T03:54:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.922+0000 7fbaf659c640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbad80762d0 0x7fbad8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:23.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.922+0000 7fbaf659c640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbad80762d0 0x7fbad8078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8158a90 tx=0x7fbaf0007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:23.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:23.926+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbae0060b70 con 0x7fbaf8141c50 2024-05-10T03:54:24.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.113+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbaf80b4190 con 0x7fbad80762d0 2024-05-10T03:54:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.119+0000 7fbaeeffd640 1 -- 172.21.15.55:0/3032800873 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7fbaf80b4190 con 0x7fbad80762d0 2024-05-10T03:54:24.125 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbad80762d0 msgr2=0x7fbad8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbad80762d0 0x7fbad8078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8158a90 tx=0x7fbaf0007900 comp rx=0 tx=0).stop 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 msgr2=0x7fbaf80ab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 0x7fbaf80ab850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c490 tx=0x7fbae000c950 comp rx=0 tx=0).stop 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 shutdown_connections 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbaf815b880 0x7fbaf80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fbad80762d0 0x7fbad8078790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbaf8141c50 0x7fbaf80ab850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 --2- 172.21.15.55:0/3032800873 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbaf8073ab0 0x7fbaf80afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 >> 172.21.15.55:0/3032800873 conn(0x7fbaf80b2cc0 msgr2=0x7fbaf8073e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 shutdown_connections 2024-05-10T03:54:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.122+0000 7fbafcbaf640 1 -- 172.21.15.55:0/3032800873 wait complete. 2024-05-10T03:54:24.137 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-05-10T03:54:23.789702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236768,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737952,"statfs":{"total":773094113280,"available":772851662848,"internally_reserved":0,"allocated":4038656,"data_stored":2255476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000862"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354625+0000","last_change":"2024-05-10T03:54:19.713943+0000","last_active":"2024-05-10T03:54:21.354625+0000","last_peered":"2024-05-10T03:54:21.354625+0000","last_clean":"2024-05-10T03:54:21.354625+0000","last_became_active":"2024-05-10T03:54:19.713618+0000","last_became_peered":"2024-05-10T03:54:19.713618+0000","last_unstale":"2024-05-10T03:54:21.354625+0000","last_undegraded":"2024-05-10T03:54:21.354625+0000","last_fullsized":"2024-05-10T03:54:21.354625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:02:42.700683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355103+0000","last_change":"2024-05-10T03:54:19.721078+0000","last_active":"2024-05-10T03:54:21.355103+0000","last_peered":"2024-05-10T03:54:21.355103+0000","last_clean":"2024-05-10T03:54:21.355103+0000","last_became_active":"2024-05-10T03:54:19.720747+0000","last_became_peered":"2024-05-10T03:54:19.720747+0000","last_unstale":"2024-05-10T03:54:21.355103+0000","last_undegraded":"2024-05-10T03:54:21.355103+0000","last_fullsized":"2024-05-10T03:54:21.355103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:10:27.195596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724704+0000","last_change":"2024-05-10T03:54:19.720080+0000","last_active":"2024-05-10T03:54:20.724704+0000","last_peered":"2024-05-10T03:54:20.724704+0000","last_clean":"2024-05-10T03:54:20.724704+0000","last_became_active":"2024-05-10T03:54:19.719575+0000","last_became_peered":"2024-05-10T03:54:19.719575+0000","last_unstale":"2024-05-10T03:54:20.724704+0000","last_undegraded":"2024-05-10T03:54:20.724704+0000","last_fullsized":"2024-05-10T03:54:20.724704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:32.779418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355518+0000","last_change":"2024-05-10T03:54:19.725391+0000","last_active":"2024-05-10T03:54:21.355518+0000","last_peered":"2024-05-10T03:54:21.355518+0000","last_clean":"2024-05-10T03:54:21.355518+0000","last_became_active":"2024-05-10T03:54:19.725127+0000","last_became_peered":"2024-05-10T03:54:19.725127+0000","last_unstale":"2024-05-10T03:54:21.355518+0000","last_undegraded":"2024-05-10T03:54:21.355518+0000","last_fullsized":"2024-05-10T03:54:21.355518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:39:33.074069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355242+0000","last_change":"2024-05-10T03:54:19.724146+0000","last_active":"2024-05-10T03:54:21.355242+0000","last_peered":"2024-05-10T03:54:21.355242+0000","last_clean":"2024-05-10T03:54:21.355242+0000","last_became_active":"2024-05-10T03:54:19.723840+0000","last_became_peered":"2024-05-10T03:54:19.723840+0000","last_unstale":"2024-05-10T03:54:21.355242+0000","last_undegraded":"2024-05-10T03:54:21.355242+0000","last_fullsized":"2024-05-10T03:54:21.355242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:19.502762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354661+0000","last_change":"2024-05-10T03:54:19.713677+0000","last_active":"2024-05-10T03:54:21.354661+0000","last_peered":"2024-05-10T03:54:21.354661+0000","last_clean":"2024-05-10T03:54:21.354661+0000","last_became_active":"2024-05-10T03:54:19.713276+0000","last_became_peered":"2024-05-10T03:54:19.713276+0000","last_unstale":"2024-05-10T03:54:21.354661+0000","last_undegraded":"2024-05-10T03:54:21.354661+0000","last_fullsized":"2024-05-10T03:54:21.354661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:56.221532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354822+0000","last_change":"2024-05-10T03:54:19.717546+0000","last_active":"2024-05-10T03:54:21.354822+0000","last_peered":"2024-05-10T03:54:21.354822+0000","last_clean":"2024-05-10T03:54:21.354822+0000","last_became_active":"2024-05-10T03:54:19.716912+0000","last_became_peered":"2024-05-10T03:54:19.716912+0000","last_unstale":"2024-05-10T03:54:21.354822+0000","last_undegraded":"2024-05-10T03:54:21.354822+0000","last_fullsized":"2024-05-10T03:54:21.354822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:11:31.565390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354341+0000","last_change":"2024-05-10T03:54:19.715504+0000","last_active":"2024-05-10T03:54:21.354341+0000","last_peered":"2024-05-10T03:54:21.354341+0000","last_clean":"2024-05-10T03:54:21.354341+0000","last_became_active":"2024-05-10T03:54:19.715007+0000","last_became_peered":"2024-05-10T03:54:19.715007+0000","last_unstale":"2024-05-10T03:54:21.354341+0000","last_undegraded":"2024-05-10T03:54:21.354341+0000","last_fullsized":"2024-05-10T03:54:21.354341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:00.096782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723870+0000","last_change":"2024-05-10T03:54:19.718402+0000","last_active":"2024-05-10T03:54:20.723870+0000","last_peered":"2024-05-10T03:54:20.723870+0000","last_clean":"2024-05-10T03:54:20.723870+0000","last_became_active":"2024-05-10T03:54:19.717238+0000","last_became_peered":"2024-05-10T03:54:19.717238+0000","last_unstale":"2024-05-10T03:54:20.723870+0000","last_undegraded":"2024-05-10T03:54:20.723870+0000","last_fullsized":"2024-05-10T03:54:20.723870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:22:40.477120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354935+0000","last_change":"2024-05-10T03:54:19.724477+0000","last_active":"2024-05-10T03:54:21.354935+0000","last_peered":"2024-05-10T03:54:21.354935+0000","last_clean":"2024-05-10T03:54:21.354935+0000","last_became_active":"2024-05-10T03:54:19.724205+0000","last_became_peered":"2024-05-10T03:54:19.724205+0000","last_unstale":"2024-05-10T03:54:21.354935+0000","last_undegraded":"2024-05-10T03:54:21.354935+0000","last_fullsized":"2024-05-10T03:54:21.354935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:47.575397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354972+0000","last_change":"2024-05-10T03:54:19.722013+0000","last_active":"2024-05-10T03:54:21.354972+0000","last_peered":"2024-05-10T03:54:21.354972+0000","last_clean":"2024-05-10T03:54:21.354972+0000","last_became_active":"2024-05-10T03:54:19.721259+0000","last_became_peered":"2024-05-10T03:54:19.721259+0000","last_unstale":"2024-05-10T03:54:21.354972+0000","last_undegraded":"2024-05-10T03:54:21.354972+0000","last_fullsized":"2024-05-10T03:54:21.354972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:57.016153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724092+0000","last_change":"2024-05-10T03:54:19.717039+0000","last_active":"2024-05-10T03:54:20.724092+0000","last_peered":"2024-05-10T03:54:20.724092+0000","last_clean":"2024-05-10T03:54:20.724092+0000","last_became_active":"2024-05-10T03:54:19.716341+0000","last_became_peered":"2024-05-10T03:54:19.716341+0000","last_unstale":"2024-05-10T03:54:20.724092+0000","last_undegraded":"2024-05-10T03:54:20.724092+0000","last_fullsized":"2024-05-10T03:54:20.724092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:11:31.565390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355247+0000","last_change":"2024-05-10T03:54:19.717889+0000","last_active":"2024-05-10T03:54:21.355247+0000","last_peered":"2024-05-10T03:54:21.355247+0000","last_clean":"2024-05-10T03:54:21.355247+0000","last_became_active":"2024-05-10T03:54:19.717608+0000","last_became_peered":"2024-05-10T03:54:19.717608+0000","last_unstale":"2024-05-10T03:54:21.355247+0000","last_undegraded":"2024-05-10T03:54:21.355247+0000","last_fullsized":"2024-05-10T03:54:21.355247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:19.897202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354949+0000","last_change":"2024-05-10T03:54:19.716534+0000","last_active":"2024-05-10T03:54:21.354949+0000","last_peered":"2024-05-10T03:54:21.354949+0000","last_clean":"2024-05-10T03:54:21.354949+0000","last_became_active":"2024-05-10T03:54:19.716276+0000","last_became_peered":"2024-05-10T03:54:19.716276+0000","last_unstale":"2024-05-10T03:54:21.354949+0000","last_undegraded":"2024-05-10T03:54:21.354949+0000","last_fullsized":"2024-05-10T03:54:21.354949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:32.779418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723266+0000","last_change":"2024-05-10T03:54:19.710156+0000","last_active":"2024-05-10T03:54:20.723266+0000","last_peered":"2024-05-10T03:54:20.723266+0000","last_clean":"2024-05-10T03:54:20.723266+0000","last_became_active":"2024-05-10T03:54:19.709868+0000","last_became_peered":"2024-05-10T03:54:19.709868+0000","last_unstale":"2024-05-10T03:54:20.723266+0000","last_undegraded":"2024-05-10T03:54:20.723266+0000","last_fullsized":"2024-05-10T03:54:20.723266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:47.687063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354883+0000","last_change":"2024-05-10T03:54:19.723063+0000","last_active":"2024-05-10T03:54:21.354883+0000","last_peered":"2024-05-10T03:54:21.354883+0000","last_clean":"2024-05-10T03:54:21.354883+0000","last_became_active":"2024-05-10T03:54:19.722717+0000","last_became_peered":"2024-05-10T03:54:19.722717+0000","last_unstale":"2024-05-10T03:54:21.354883+0000","last_undegraded":"2024-05-10T03:54:21.354883+0000","last_fullsized":"2024-05-10T03:54:21.354883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:56.221532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355289+0000","last_change":"2024-05-10T03:54:19.715935+0000","last_active":"2024-05-10T03:54:21.355289+0000","last_peered":"2024-05-10T03:54:21.355289+0000","last_clean":"2024-05-10T03:54:21.355289+0000","last_became_active":"2024-05-10T03:54:19.715147+0000","last_became_peered":"2024-05-10T03:54:19.715147+0000","last_unstale":"2024-05-10T03:54:21.355289+0000","last_undegraded":"2024-05-10T03:54:21.355289+0000","last_fullsized":"2024-05-10T03:54:21.355289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:32.779418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355261+0000","last_change":"2024-05-10T03:54:19.723068+0000","last_active":"2024-05-10T03:54:21.355261+0000","last_peered":"2024-05-10T03:54:21.355261+0000","last_clean":"2024-05-10T03:54:21.355261+0000","last_became_active":"2024-05-10T03:54:19.722752+0000","last_became_peered":"2024-05-10T03:54:19.722752+0000","last_unstale":"2024-05-10T03:54:21.355261+0000","last_undegraded":"2024-05-10T03:54:21.355261+0000","last_fullsized":"2024-05-10T03:54:21.355261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:36.113411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354340+0000","last_change":"2024-05-10T03:54:19.723217+0000","last_active":"2024-05-10T03:54:21.354340+0000","last_peered":"2024-05-10T03:54:21.354340+0000","last_clean":"2024-05-10T03:54:21.354340+0000","last_became_active":"2024-05-10T03:54:19.722705+0000","last_became_peered":"2024-05-10T03:54:19.722705+0000","last_unstale":"2024-05-10T03:54:21.354340+0000","last_undegraded":"2024-05-10T03:54:21.354340+0000","last_fullsized":"2024-05-10T03:54:21.354340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:11:31.565390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354886+0000","last_change":"2024-05-10T03:54:19.712591+0000","last_active":"2024-05-10T03:54:21.354886+0000","last_peered":"2024-05-10T03:54:21.354886+0000","last_clean":"2024-05-10T03:54:21.354886+0000","last_became_active":"2024-05-10T03:54:19.712298+0000","last_became_peered":"2024-05-10T03:54:19.712298+0000","last_unstale":"2024-05-10T03:54:21.354886+0000","last_undegraded":"2024-05-10T03:54:21.354886+0000","last_fullsized":"2024-05-10T03:54:21.354886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:14.863521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723321+0000","last_change":"2024-05-10T03:54:19.719800+0000","last_active":"2024-05-10T03:54:20.723321+0000","last_peered":"2024-05-10T03:54:20.723321+0000","last_clean":"2024-05-10T03:54:20.723321+0000","last_became_active":"2024-05-10T03:54:19.719504+0000","last_became_peered":"2024-05-10T03:54:19.719504+0000","last_unstale":"2024-05-10T03:54:20.723321+0000","last_undegraded":"2024-05-10T03:54:20.723321+0000","last_fullsized":"2024-05-10T03:54:20.723321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:57.481147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724603+0000","last_change":"2024-05-10T03:54:19.716426+0000","last_active":"2024-05-10T03:54:20.724603+0000","last_peered":"2024-05-10T03:54:20.724603+0000","last_clean":"2024-05-10T03:54:20.724603+0000","last_became_active":"2024-05-10T03:54:19.715511+0000","last_became_peered":"2024-05-10T03:54:19.715511+0000","last_unstale":"2024-05-10T03:54:20.724603+0000","last_undegraded":"2024-05-10T03:54:20.724603+0000","last_fullsized":"2024-05-10T03:54:20.724603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:12.472570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726038+0000","last_change":"2024-05-10T03:54:19.715063+0000","last_active":"2024-05-10T03:54:20.726038+0000","last_peered":"2024-05-10T03:54:20.726038+0000","last_clean":"2024-05-10T03:54:20.726038+0000","last_became_active":"2024-05-10T03:54:19.714763+0000","last_became_peered":"2024-05-10T03:54:19.714763+0000","last_unstale":"2024-05-10T03:54:20.726038+0000","last_undegraded":"2024-05-10T03:54:20.726038+0000","last_fullsized":"2024-05-10T03:54:20.726038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:37:15.502698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.722887+0000","last_change":"2024-05-10T03:54:19.707950+0000","last_active":"2024-05-10T03:54:20.722887+0000","last_peered":"2024-05-10T03:54:20.722887+0000","last_clean":"2024-05-10T03:54:20.722887+0000","last_became_active":"2024-05-10T03:54:19.707605+0000","last_became_peered":"2024-05-10T03:54:19.707605+0000","last_unstale":"2024-05-10T03:54:20.722887+0000","last_undegraded":"2024-05-10T03:54:20.722887+0000","last_fullsized":"2024-05-10T03:54:20.722887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:39:33.074069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355160+0000","last_change":"2024-05-10T03:54:19.716465+0000","last_active":"2024-05-10T03:54:21.355160+0000","last_peered":"2024-05-10T03:54:21.355160+0000","last_clean":"2024-05-10T03:54:21.355160+0000","last_became_active":"2024-05-10T03:54:19.716208+0000","last_became_peered":"2024-05-10T03:54:19.716208+0000","last_unstale":"2024-05-10T03:54:21.355160+0000","last_undegraded":"2024-05-10T03:54:21.355160+0000","last_fullsized":"2024-05-10T03:54:21.355160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.069898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355417+0000","last_change":"2024-05-10T03:54:19.722865+0000","last_active":"2024-05-10T03:54:21.355417+0000","last_peered":"2024-05-10T03:54:21.355417+0000","last_clean":"2024-05-10T03:54:21.355417+0000","last_became_active":"2024-05-10T03:54:19.722399+0000","last_became_peered":"2024-05-10T03:54:19.722399+0000","last_unstale":"2024-05-10T03:54:21.355417+0000","last_undegraded":"2024-05-10T03:54:21.355417+0000","last_fullsized":"2024-05-10T03:54:21.355417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:06:06.968648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355604+0000","last_change":"2024-05-10T03:54:19.728239+0000","last_active":"2024-05-10T03:54:21.355604+0000","last_peered":"2024-05-10T03:54:21.355604+0000","last_clean":"2024-05-10T03:54:21.355604+0000","last_became_active":"2024-05-10T03:54:19.728001+0000","last_became_peered":"2024-05-10T03:54:19.728001+0000","last_unstale":"2024-05-10T03:54:21.355604+0000","last_undegraded":"2024-05-10T03:54:21.355604+0000","last_fullsized":"2024-05-10T03:54:21.355604+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:47.687063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724290+0000","last_change":"2024-05-10T03:54:19.717265+0000","last_active":"2024-05-10T03:54:20.724290+0000","last_peered":"2024-05-10T03:54:20.724290+0000","last_clean":"2024-05-10T03:54:20.724290+0000","last_became_active":"2024-05-10T03:54:19.716741+0000","last_became_peered":"2024-05-10T03:54:19.716741+0000","last_unstale":"2024-05-10T03:54:20.724290+0000","last_undegraded":"2024-05-10T03:54:20.724290+0000","last_fullsized":"2024-05-10T03:54:20.724290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:56.221532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724793+0000","last_change":"2024-05-10T03:54:19.715006+0000","last_active":"2024-05-10T03:54:20.724793+0000","last_peered":"2024-05-10T03:54:20.724793+0000","last_clean":"2024-05-10T03:54:20.724793+0000","last_became_active":"2024-05-10T03:54:19.714726+0000","last_became_peered":"2024-05-10T03:54:19.714726+0000","last_unstale":"2024-05-10T03:54:20.724793+0000","last_undegraded":"2024-05-10T03:54:20.724793+0000","last_fullsized":"2024-05-10T03:54:20.724793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:28.355624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354499+0000","last_change":"2024-05-10T03:54:19.711981+0000","last_active":"2024-05-10T03:54:21.354499+0000","last_peered":"2024-05-10T03:54:21.354499+0000","last_clean":"2024-05-10T03:54:21.354499+0000","last_became_active":"2024-05-10T03:54:19.711670+0000","last_became_peered":"2024-05-10T03:54:19.711670+0000","last_unstale":"2024-05-10T03:54:21.354499+0000","last_undegraded":"2024-05-10T03:54:21.354499+0000","last_fullsized":"2024-05-10T03:54:21.354499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:53:47.575397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355115+0000","last_change":"2024-05-10T03:54:19.708531+0000","last_active":"2024-05-10T03:54:21.355115+0000","last_peered":"2024-05-10T03:54:21.355115+0000","last_clean":"2024-05-10T03:54:21.355115+0000","last_became_active":"2024-05-10T03:54:19.708230+0000","last_became_peered":"2024-05-10T03:54:19.708230+0000","last_unstale":"2024-05-10T03:54:21.355115+0000","last_undegraded":"2024-05-10T03:54:21.355115+0000","last_fullsized":"2024-05-10T03:54:21.355115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:26.105544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354766+0000","last_change":"2024-05-10T03:54:19.718984+0000","last_active":"2024-05-10T03:54:21.354766+0000","last_peered":"2024-05-10T03:54:21.354766+0000","last_clean":"2024-05-10T03:54:21.354766+0000","last_became_active":"2024-05-10T03:54:19.718718+0000","last_became_peered":"2024-05-10T03:54:19.718718+0000","last_unstale":"2024-05-10T03:54:21.354766+0000","last_undegraded":"2024-05-10T03:54:21.354766+0000","last_fullsized":"2024-05-10T03:54:21.354766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:56.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726245+0000","last_change":"2024-05-10T03:54:19.709016+0000","last_active":"2024-05-10T03:54:20.726245+0000","last_peered":"2024-05-10T03:54:20.726245+0000","last_clean":"2024-05-10T03:54:20.726245+0000","last_became_active":"2024-05-10T03:54:19.708720+0000","last_became_peered":"2024-05-10T03:54:19.708720+0000","last_unstale":"2024-05-10T03:54:20.726245+0000","last_undegraded":"2024-05-10T03:54:20.726245+0000","last_fullsized":"2024-05-10T03:54:20.726245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:57.481147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355275+0000","last_change":"2024-05-10T03:54:18.713680+0000","last_active":"2024-05-10T03:54:21.355275+0000","last_peered":"2024-05-10T03:54:21.355275+0000","last_clean":"2024-05-10T03:54:21.355275+0000","last_became_active":"2024-05-10T03:54:18.713292+0000","last_became_peered":"2024-05-10T03:54:18.713292+0000","last_unstale":"2024-05-10T03:54:21.355275+0000","last_undegraded":"2024-05-10T03:54:21.355275+0000","last_fullsized":"2024-05-10T03:54:21.355275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:47.852977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355215+0000","last_change":"2024-05-10T03:54:19.717418+0000","last_active":"2024-05-10T03:54:21.355215+0000","last_peered":"2024-05-10T03:54:21.355215+0000","last_clean":"2024-05-10T03:54:21.355215+0000","last_became_active":"2024-05-10T03:54:19.717103+0000","last_became_peered":"2024-05-10T03:54:19.717103+0000","last_unstale":"2024-05-10T03:54:21.355215+0000","last_undegraded":"2024-05-10T03:54:21.355215+0000","last_fullsized":"2024-05-10T03:54:21.355215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:20:06.087846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726202+0000","last_change":"2024-05-10T03:54:18.714748+0000","last_active":"2024-05-10T03:54:20.726202+0000","last_peered":"2024-05-10T03:54:20.726202+0000","last_clean":"2024-05-10T03:54:20.726202+0000","last_became_active":"2024-05-10T03:54:18.714418+0000","last_became_peered":"2024-05-10T03:54:18.714418+0000","last_unstale":"2024-05-10T03:54:20.726202+0000","last_undegraded":"2024-05-10T03:54:20.726202+0000","last_fullsized":"2024-05-10T03:54:20.726202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:16:56.639798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723702+0000","last_change":"2024-05-10T03:54:19.725669+0000","last_active":"2024-05-10T03:54:20.723702+0000","last_peered":"2024-05-10T03:54:20.723702+0000","last_clean":"2024-05-10T03:54:20.723702+0000","last_became_active":"2024-05-10T03:54:19.725359+0000","last_became_peered":"2024-05-10T03:54:19.725359+0000","last_unstale":"2024-05-10T03:54:20.723702+0000","last_undegraded":"2024-05-10T03:54:20.723702+0000","last_fullsized":"2024-05-10T03:54:20.723702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:35:04.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354420+0000","last_change":"2024-05-10T03:54:18.716873+0000","last_active":"2024-05-10T03:54:21.354420+0000","last_peered":"2024-05-10T03:54:21.354420+0000","last_clean":"2024-05-10T03:54:21.354420+0000","last_became_active":"2024-05-10T03:54:18.716560+0000","last_became_peered":"2024-05-10T03:54:18.716560+0000","last_unstale":"2024-05-10T03:54:21.354420+0000","last_undegraded":"2024-05-10T03:54:21.354420+0000","last_fullsized":"2024-05-10T03:54:21.354420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:01.165172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355773+0000","last_change":"2024-05-10T03:54:19.727037+0000","last_active":"2024-05-10T03:54:21.355773+0000","last_peered":"2024-05-10T03:54:21.355773+0000","last_clean":"2024-05-10T03:54:21.355773+0000","last_became_active":"2024-05-10T03:54:19.726741+0000","last_became_peered":"2024-05-10T03:54:19.726741+0000","last_unstale":"2024-05-10T03:54:21.355773+0000","last_undegraded":"2024-05-10T03:54:21.355773+0000","last_fullsized":"2024-05-10T03:54:21.355773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:56.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355012+0000","last_change":"2024-05-10T03:54:18.711451+0000","last_active":"2024-05-10T03:54:21.355012+0000","last_peered":"2024-05-10T03:54:21.355012+0000","last_clean":"2024-05-10T03:54:21.355012+0000","last_became_active":"2024-05-10T03:54:18.710969+0000","last_became_peered":"2024-05-10T03:54:18.710969+0000","last_unstale":"2024-05-10T03:54:21.355012+0000","last_undegraded":"2024-05-10T03:54:21.355012+0000","last_fullsized":"2024-05-10T03:54:21.355012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:00.669526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354697+0000","last_change":"2024-05-10T03:54:19.720255+0000","last_active":"2024-05-10T03:54:21.354697+0000","last_peered":"2024-05-10T03:54:21.354697+0000","last_clean":"2024-05-10T03:54:21.354697+0000","last_became_active":"2024-05-10T03:54:19.719638+0000","last_became_peered":"2024-05-10T03:54:19.719638+0000","last_unstale":"2024-05-10T03:54:21.354697+0000","last_undegraded":"2024-05-10T03:54:21.354697+0000","last_fullsized":"2024-05-10T03:54:21.354697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:06:00.041206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724678+0000","last_change":"2024-05-10T03:54:18.708118+0000","last_active":"2024-05-10T03:54:20.724678+0000","last_peered":"2024-05-10T03:54:20.724678+0000","last_clean":"2024-05-10T03:54:20.724678+0000","last_became_active":"2024-05-10T03:54:18.707796+0000","last_became_peered":"2024-05-10T03:54:18.707796+0000","last_unstale":"2024-05-10T03:54:20.724678+0000","last_undegraded":"2024-05-10T03:54:20.724678+0000","last_fullsized":"2024-05-10T03:54:20.724678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:01.551880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723367+0000","last_change":"2024-05-10T03:54:19.720947+0000","last_active":"2024-05-10T03:54:20.723367+0000","last_peered":"2024-05-10T03:54:20.723367+0000","last_clean":"2024-05-10T03:54:20.723367+0000","last_became_active":"2024-05-10T03:54:19.717538+0000","last_became_peered":"2024-05-10T03:54:19.717538+0000","last_unstale":"2024-05-10T03:54:20.723367+0000","last_undegraded":"2024-05-10T03:54:20.723367+0000","last_fullsized":"2024-05-10T03:54:20.723367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:06:00.041206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724533+0000","last_change":"2024-05-10T03:54:18.708200+0000","last_active":"2024-05-10T03:54:20.724533+0000","last_peered":"2024-05-10T03:54:20.724533+0000","last_clean":"2024-05-10T03:54:20.724533+0000","last_became_active":"2024-05-10T03:54:18.707827+0000","last_became_peered":"2024-05-10T03:54:18.707827+0000","last_unstale":"2024-05-10T03:54:20.724533+0000","last_undegraded":"2024-05-10T03:54:20.724533+0000","last_fullsized":"2024-05-10T03:54:20.724533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:18.493101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723115+0000","last_change":"2024-05-10T03:54:19.709003+0000","last_active":"2024-05-10T03:54:20.723115+0000","last_peered":"2024-05-10T03:54:20.723115+0000","last_clean":"2024-05-10T03:54:20.723115+0000","last_became_active":"2024-05-10T03:54:19.708667+0000","last_became_peered":"2024-05-10T03:54:19.708667+0000","last_unstale":"2024-05-10T03:54:20.723115+0000","last_undegraded":"2024-05-10T03:54:20.723115+0000","last_fullsized":"2024-05-10T03:54:20.723115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:20:06.087846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354532+0000","last_change":"2024-05-10T03:54:18.710216+0000","last_active":"2024-05-10T03:54:21.354532+0000","last_peered":"2024-05-10T03:54:21.354532+0000","last_clean":"2024-05-10T03:54:21.354532+0000","last_became_active":"2024-05-10T03:54:18.709884+0000","last_became_peered":"2024-05-10T03:54:18.709884+0000","last_unstale":"2024-05-10T03:54:21.354532+0000","last_undegraded":"2024-05-10T03:54:21.354532+0000","last_fullsized":"2024-05-10T03:54:21.354532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:25.095883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354617+0000","last_change":"2024-05-10T03:54:19.721626+0000","last_active":"2024-05-10T03:54:21.354617+0000","last_peered":"2024-05-10T03:54:21.354617+0000","last_clean":"2024-05-10T03:54:21.354617+0000","last_became_active":"2024-05-10T03:54:19.721348+0000","last_became_peered":"2024-05-10T03:54:19.721348+0000","last_unstale":"2024-05-10T03:54:21.354617+0000","last_undegraded":"2024-05-10T03:54:21.354617+0000","last_fullsized":"2024-05-10T03:54:21.354617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:28.355624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724347+0000","last_change":"2024-05-10T03:54:18.710188+0000","last_active":"2024-05-10T03:54:20.724347+0000","last_peered":"2024-05-10T03:54:20.724347+0000","last_clean":"2024-05-10T03:54:20.724347+0000","last_became_active":"2024-05-10T03:54:18.709883+0000","last_became_peered":"2024-05-10T03:54:18.709883+0000","last_unstale":"2024-05-10T03:54:20.724347+0000","last_undegraded":"2024-05-10T03:54:20.724347+0000","last_fullsized":"2024-05-10T03:54:20.724347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:13.853860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723884+0000","last_change":"2024-05-10T03:54:19.715024+0000","last_active":"2024-05-10T03:54:20.723884+0000","last_peered":"2024-05-10T03:54:20.723884+0000","last_clean":"2024-05-10T03:54:20.723884+0000","last_became_active":"2024-05-10T03:54:19.714745+0000","last_became_peered":"2024-05-10T03:54:19.714745+0000","last_unstale":"2024-05-10T03:54:20.723884+0000","last_undegraded":"2024-05-10T03:54:20.723884+0000","last_fullsized":"2024-05-10T03:54:20.723884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:56.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354661+0000","last_change":"2024-05-10T03:54:18.715744+0000","last_active":"2024-05-10T03:54:21.354661+0000","last_peered":"2024-05-10T03:54:21.354661+0000","last_clean":"2024-05-10T03:54:21.354661+0000","last_became_active":"2024-05-10T03:54:18.715458+0000","last_became_peered":"2024-05-10T03:54:18.715458+0000","last_unstale":"2024-05-10T03:54:21.354661+0000","last_undegraded":"2024-05-10T03:54:21.354661+0000","last_fullsized":"2024-05-10T03:54:21.354661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:02:41.691022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355498+0000","last_change":"2024-05-10T03:54:19.723507+0000","last_active":"2024-05-10T03:54:21.355498+0000","last_peered":"2024-05-10T03:54:21.355498+0000","last_clean":"2024-05-10T03:54:21.355498+0000","last_became_active":"2024-05-10T03:54:19.723208+0000","last_became_peered":"2024-05-10T03:54:19.723208+0000","last_unstale":"2024-05-10T03:54:21.355498+0000","last_undegraded":"2024-05-10T03:54:21.355498+0000","last_fullsized":"2024-05-10T03:54:21.355498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:33:06.161841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726297+0000","last_change":"2024-05-10T03:54:18.717754+0000","last_active":"2024-05-10T03:54:20.726297+0000","last_peered":"2024-05-10T03:54:20.726297+0000","last_clean":"2024-05-10T03:54:20.726297+0000","last_became_active":"2024-05-10T03:54:18.717327+0000","last_became_peered":"2024-05-10T03:54:18.717327+0000","last_unstale":"2024-05-10T03:54:20.726297+0000","last_undegraded":"2024-05-10T03:54:20.726297+0000","last_fullsized":"2024-05-10T03:54:20.726297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:30.436556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355042+0000","last_change":"2024-05-10T03:54:19.724769+0000","last_active":"2024-05-10T03:54:21.355042+0000","last_peered":"2024-05-10T03:54:21.355042+0000","last_clean":"2024-05-10T03:54:21.355042+0000","last_became_active":"2024-05-10T03:54:19.724495+0000","last_became_peered":"2024-05-10T03:54:19.724495+0000","last_unstale":"2024-05-10T03:54:21.355042+0000","last_undegraded":"2024-05-10T03:54:21.355042+0000","last_fullsized":"2024-05-10T03:54:21.355042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:17.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724781+0000","last_change":"2024-05-10T03:54:18.715553+0000","last_active":"2024-05-10T03:54:20.724781+0000","last_peered":"2024-05-10T03:54:20.724781+0000","last_clean":"2024-05-10T03:54:20.724781+0000","last_became_active":"2024-05-10T03:54:18.715208+0000","last_became_peered":"2024-05-10T03:54:18.715208+0000","last_unstale":"2024-05-10T03:54:20.724781+0000","last_undegraded":"2024-05-10T03:54:20.724781+0000","last_fullsized":"2024-05-10T03:54:20.724781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:37:14.493037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724508+0000","last_change":"2024-05-10T03:54:19.719854+0000","last_active":"2024-05-10T03:54:20.724508+0000","last_peered":"2024-05-10T03:54:20.724508+0000","last_clean":"2024-05-10T03:54:20.724508+0000","last_became_active":"2024-05-10T03:54:19.719195+0000","last_became_peered":"2024-05-10T03:54:19.719195+0000","last_unstale":"2024-05-10T03:54:20.724508+0000","last_undegraded":"2024-05-10T03:54:20.724508+0000","last_fullsized":"2024-05-10T03:54:20.724508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:57.016153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355120+0000","last_change":"2024-05-10T03:54:18.718007+0000","last_active":"2024-05-10T03:54:21.355120+0000","last_peered":"2024-05-10T03:54:21.355120+0000","last_clean":"2024-05-10T03:54:21.355120+0000","last_became_active":"2024-05-10T03:54:18.717714+0000","last_became_peered":"2024-05-10T03:54:18.717714+0000","last_unstale":"2024-05-10T03:54:21.355120+0000","last_undegraded":"2024-05-10T03:54:21.355120+0000","last_fullsized":"2024-05-10T03:54:21.355120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:20:05.078185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354669+0000","last_change":"2024-05-10T03:54:19.725065+0000","last_active":"2024-05-10T03:54:21.354669+0000","last_peered":"2024-05-10T03:54:21.354669+0000","last_clean":"2024-05-10T03:54:21.354669+0000","last_became_active":"2024-05-10T03:54:19.724766+0000","last_became_peered":"2024-05-10T03:54:19.724766+0000","last_unstale":"2024-05-10T03:54:21.354669+0000","last_undegraded":"2024-05-10T03:54:21.354669+0000","last_fullsized":"2024-05-10T03:54:21.354669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:09:00.096782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724800+0000","last_change":"2024-05-10T03:54:18.710880+0000","last_active":"2024-05-10T03:54:20.724800+0000","last_peered":"2024-05-10T03:54:20.724800+0000","last_clean":"2024-05-10T03:54:20.724800+0000","last_became_active":"2024-05-10T03:54:18.710613+0000","last_became_peered":"2024-05-10T03:54:18.710613+0000","last_unstale":"2024-05-10T03:54:20.724800+0000","last_undegraded":"2024-05-10T03:54:20.724800+0000","last_fullsized":"2024-05-10T03:54:20.724800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:21.007547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354937+0000","last_change":"2024-05-10T03:54:19.721781+0000","last_active":"2024-05-10T03:54:21.354937+0000","last_peered":"2024-05-10T03:54:21.354937+0000","last_clean":"2024-05-10T03:54:21.354937+0000","last_became_active":"2024-05-10T03:54:19.721435+0000","last_became_peered":"2024-05-10T03:54:19.721435+0000","last_unstale":"2024-05-10T03:54:21.354937+0000","last_undegraded":"2024-05-10T03:54:21.354937+0000","last_fullsized":"2024-05-10T03:54:21.354937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:57.016153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354729+0000","last_change":"2024-05-10T03:54:18.715814+0000","last_active":"2024-05-10T03:54:21.354729+0000","last_peered":"2024-05-10T03:54:21.354729+0000","last_clean":"2024-05-10T03:54:21.354729+0000","last_became_active":"2024-05-10T03:54:18.715557+0000","last_became_peered":"2024-05-10T03:54:18.715557+0000","last_unstale":"2024-05-10T03:54:21.354729+0000","last_undegraded":"2024-05-10T03:54:21.354729+0000","last_fullsized":"2024-05-10T03:54:21.354729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:02:41.691022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354533+0000","last_change":"2024-05-10T03:54:19.721193+0000","last_active":"2024-05-10T03:54:21.354533+0000","last_peered":"2024-05-10T03:54:21.354533+0000","last_clean":"2024-05-10T03:54:21.354533+0000","last_became_active":"2024-05-10T03:54:19.720700+0000","last_became_peered":"2024-05-10T03:54:19.720700+0000","last_unstale":"2024-05-10T03:54:21.354533+0000","last_undegraded":"2024-05-10T03:54:21.354533+0000","last_fullsized":"2024-05-10T03:54:21.354533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:39:33.074069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354652+0000","last_change":"2024-05-10T03:54:18.715842+0000","last_active":"2024-05-10T03:54:21.354652+0000","last_peered":"2024-05-10T03:54:21.354652+0000","last_clean":"2024-05-10T03:54:21.354652+0000","last_became_active":"2024-05-10T03:54:18.715550+0000","last_became_peered":"2024-05-10T03:54:18.715550+0000","last_unstale":"2024-05-10T03:54:21.354652+0000","last_undegraded":"2024-05-10T03:54:21.354652+0000","last_fullsized":"2024-05-10T03:54:21.354652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:37:14.493037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355169+0000","last_change":"2024-05-10T03:54:19.718280+0000","last_active":"2024-05-10T03:54:21.355169+0000","last_peered":"2024-05-10T03:54:21.355169+0000","last_clean":"2024-05-10T03:54:21.355169+0000","last_became_active":"2024-05-10T03:54:19.717919+0000","last_became_peered":"2024-05-10T03:54:19.717919+0000","last_unstale":"2024-05-10T03:54:21.355169+0000","last_undegraded":"2024-05-10T03:54:21.355169+0000","last_fullsized":"2024-05-10T03:54:21.355169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:37:15.502698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354735+0000","last_change":"2024-05-10T03:54:18.714008+0000","last_active":"2024-05-10T03:54:21.354735+0000","last_peered":"2024-05-10T03:54:21.354735+0000","last_clean":"2024-05-10T03:54:21.354735+0000","last_became_active":"2024-05-10T03:54:18.713603+0000","last_became_peered":"2024-05-10T03:54:18.713603+0000","last_unstale":"2024-05-10T03:54:21.354735+0000","last_undegraded":"2024-05-10T03:54:21.354735+0000","last_fullsized":"2024-05-10T03:54:21.354735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:20.862218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723558+0000","last_change":"2024-05-10T03:54:19.718655+0000","last_active":"2024-05-10T03:54:20.723558+0000","last_peered":"2024-05-10T03:54:20.723558+0000","last_clean":"2024-05-10T03:54:20.723558+0000","last_became_active":"2024-05-10T03:54:19.717012+0000","last_became_peered":"2024-05-10T03:54:19.717012+0000","last_unstale":"2024-05-10T03:54:20.723558+0000","last_undegraded":"2024-05-10T03:54:20.723558+0000","last_fullsized":"2024-05-10T03:54:20.723558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:50:30.517670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355371+0000","last_change":"2024-05-10T03:54:18.714998+0000","last_active":"2024-05-10T03:54:21.355371+0000","last_peered":"2024-05-10T03:54:21.355371+0000","last_clean":"2024-05-10T03:54:21.355371+0000","last_became_active":"2024-05-10T03:54:18.714702+0000","last_became_peered":"2024-05-10T03:54:18.714702+0000","last_unstale":"2024-05-10T03:54:21.355371+0000","last_undegraded":"2024-05-10T03:54:21.355371+0000","last_fullsized":"2024-05-10T03:54:21.355371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:38.364564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.725089+0000","last_change":"2024-05-10T03:54:19.715525+0000","last_active":"2024-05-10T03:54:20.725089+0000","last_peered":"2024-05-10T03:54:20.725089+0000","last_clean":"2024-05-10T03:54:20.725089+0000","last_became_active":"2024-05-10T03:54:19.715186+0000","last_became_peered":"2024-05-10T03:54:19.715186+0000","last_unstale":"2024-05-10T03:54:20.725089+0000","last_undegraded":"2024-05-10T03:54:20.725089+0000","last_fullsized":"2024-05-10T03:54:20.725089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:17.461505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723635+0000","last_change":"2024-05-10T03:54:18.710214+0000","last_active":"2024-05-10T03:54:20.723635+0000","last_peered":"2024-05-10T03:54:20.723635+0000","last_clean":"2024-05-10T03:54:20.723635+0000","last_became_active":"2024-05-10T03:54:18.709913+0000","last_became_peered":"2024-05-10T03:54:18.709913+0000","last_unstale":"2024-05-10T03:54:20.723635+0000","last_undegraded":"2024-05-10T03:54:20.723635+0000","last_fullsized":"2024-05-10T03:54:20.723635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:40.796070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355651+0000","last_change":"2024-05-10T03:54:19.726796+0000","last_active":"2024-05-10T03:54:21.355651+0000","last_peered":"2024-05-10T03:54:21.355651+0000","last_clean":"2024-05-10T03:54:21.355651+0000","last_became_active":"2024-05-10T03:54:19.725589+0000","last_became_peered":"2024-05-10T03:54:19.725589+0000","last_unstale":"2024-05-10T03:54:21.355651+0000","last_undegraded":"2024-05-10T03:54:21.355651+0000","last_fullsized":"2024-05-10T03:54:21.355651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:06:00.041206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.724216+0000","last_change":"2024-05-10T03:54:18.707611+0000","last_active":"2024-05-10T03:54:20.724216+0000","last_peered":"2024-05-10T03:54:20.724216+0000","last_clean":"2024-05-10T03:54:20.724216+0000","last_became_active":"2024-05-10T03:54:18.706793+0000","last_became_peered":"2024-05-10T03:54:18.706793+0000","last_unstale":"2024-05-10T03:54:20.724216+0000","last_undegraded":"2024-05-10T03:54:20.724216+0000","last_fullsized":"2024-05-10T03:54:20.724216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:50.644842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355690+0000","last_change":"2024-05-10T03:54:19.715003+0000","last_active":"2024-05-10T03:54:21.355690+0000","last_peered":"2024-05-10T03:54:21.355690+0000","last_clean":"2024-05-10T03:54:21.355690+0000","last_became_active":"2024-05-10T03:54:19.714721+0000","last_became_peered":"2024-05-10T03:54:19.714721+0000","last_unstale":"2024-05-10T03:54:21.355690+0000","last_undegraded":"2024-05-10T03:54:21.355690+0000","last_fullsized":"2024-05-10T03:54:21.355690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:22.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723762+0000","last_change":"2024-05-10T03:54:18.708278+0000","last_active":"2024-05-10T03:54:20.723762+0000","last_peered":"2024-05-10T03:54:20.723762+0000","last_clean":"2024-05-10T03:54:20.723762+0000","last_became_active":"2024-05-10T03:54:18.707945+0000","last_became_peered":"2024-05-10T03:54:18.707945+0000","last_unstale":"2024-05-10T03:54:20.723762+0000","last_undegraded":"2024-05-10T03:54:20.723762+0000","last_fullsized":"2024-05-10T03:54:20.723762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:38.913527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354615+0000","last_change":"2024-05-10T03:54:19.714219+0000","last_active":"2024-05-10T03:54:21.354615+0000","last_peered":"2024-05-10T03:54:21.354615+0000","last_clean":"2024-05-10T03:54:21.354615+0000","last_became_active":"2024-05-10T03:54:19.713923+0000","last_became_peered":"2024-05-10T03:54:19.713923+0000","last_unstale":"2024-05-10T03:54:21.354615+0000","last_undegraded":"2024-05-10T03:54:21.354615+0000","last_fullsized":"2024-05-10T03:54:21.354615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:02.561541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726142+0000","last_change":"2024-05-10T03:54:18.717081+0000","last_active":"2024-05-10T03:54:20.726142+0000","last_peered":"2024-05-10T03:54:20.726142+0000","last_clean":"2024-05-10T03:54:20.726142+0000","last_became_active":"2024-05-10T03:54:18.715399+0000","last_became_peered":"2024-05-10T03:54:18.715399+0000","last_unstale":"2024-05-10T03:54:20.726142+0000","last_undegraded":"2024-05-10T03:54:20.726142+0000","last_fullsized":"2024-05-10T03:54:20.726142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:21.007547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355418+0000","last_change":"2024-05-10T03:54:19.716253+0000","last_active":"2024-05-10T03:54:21.355418+0000","last_peered":"2024-05-10T03:54:21.355418+0000","last_clean":"2024-05-10T03:54:21.355418+0000","last_became_active":"2024-05-10T03:54:19.715942+0000","last_became_peered":"2024-05-10T03:54:19.715942+0000","last_unstale":"2024-05-10T03:54:21.355418+0000","last_undegraded":"2024-05-10T03:54:21.355418+0000","last_fullsized":"2024-05-10T03:54:21.355418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:48.862638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355077+0000","last_change":"2024-05-10T03:54:18.718448+0000","last_active":"2024-05-10T03:54:21.355077+0000","last_peered":"2024-05-10T03:54:21.355077+0000","last_clean":"2024-05-10T03:54:21.355077+0000","last_became_active":"2024-05-10T03:54:18.718127+0000","last_became_peered":"2024-05-10T03:54:18.718127+0000","last_unstale":"2024-05-10T03:54:21.355077+0000","last_undegraded":"2024-05-10T03:54:21.355077+0000","last_fullsized":"2024-05-10T03:54:21.355077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:34:21.007547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354392+0000","last_change":"2024-05-10T03:54:19.708485+0000","last_active":"2024-05-10T03:54:21.354392+0000","last_peered":"2024-05-10T03:54:21.354392+0000","last_clean":"2024-05-10T03:54:21.354392+0000","last_became_active":"2024-05-10T03:54:19.708218+0000","last_became_peered":"2024-05-10T03:54:19.708218+0000","last_unstale":"2024-05-10T03:54:21.354392+0000","last_undegraded":"2024-05-10T03:54:21.354392+0000","last_fullsized":"2024-05-10T03:54:21.354392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:59:41.805731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723331+0000","last_change":"2024-05-10T03:54:18.712477+0000","last_active":"2024-05-10T03:54:20.723331+0000","last_peered":"2024-05-10T03:54:20.723331+0000","last_clean":"2024-05-10T03:54:20.723331+0000","last_became_active":"2024-05-10T03:54:18.712201+0000","last_became_peered":"2024-05-10T03:54:18.712201+0000","last_unstale":"2024-05-10T03:54:20.723331+0000","last_undegraded":"2024-05-10T03:54:20.723331+0000","last_fullsized":"2024-05-10T03:54:20.723331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:18.887541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354513+0000","last_change":"2024-05-10T03:54:19.717328+0000","last_active":"2024-05-10T03:54:21.354513+0000","last_peered":"2024-05-10T03:54:21.354513+0000","last_clean":"2024-05-10T03:54:21.354513+0000","last_became_active":"2024-05-10T03:54:19.716564+0000","last_became_peered":"2024-05-10T03:54:19.716564+0000","last_unstale":"2024-05-10T03:54:21.354513+0000","last_undegraded":"2024-05-10T03:54:21.354513+0000","last_fullsized":"2024-05-10T03:54:21.354513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:27.069898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.722778+0000","last_change":"2024-05-10T03:54:18.715843+0000","last_active":"2024-05-10T03:54:20.722778+0000","last_peered":"2024-05-10T03:54:20.722778+0000","last_clean":"2024-05-10T03:54:20.722778+0000","last_became_active":"2024-05-10T03:54:18.715512+0000","last_became_peered":"2024-05-10T03:54:18.715512+0000","last_unstale":"2024-05-10T03:54:20.722778+0000","last_undegraded":"2024-05-10T03:54:20.722778+0000","last_fullsized":"2024-05-10T03:54:20.722778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:25.095883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355340+0000","last_change":"2024-05-10T03:54:19.712207+0000","last_active":"2024-05-10T03:54:21.355340+0000","last_peered":"2024-05-10T03:54:21.355340+0000","last_clean":"2024-05-10T03:54:21.355340+0000","last_became_active":"2024-05-10T03:54:19.711901+0000","last_became_peered":"2024-05-10T03:54:19.711901+0000","last_unstale":"2024-05-10T03:54:21.355340+0000","last_undegraded":"2024-05-10T03:54:21.355340+0000","last_fullsized":"2024-05-10T03:54:21.355340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:39.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355523+0000","last_change":"2024-05-10T03:54:18.710895+0000","last_active":"2024-05-10T03:54:21.355523+0000","last_peered":"2024-05-10T03:54:21.355523+0000","last_clean":"2024-05-10T03:54:21.355523+0000","last_became_active":"2024-05-10T03:54:18.710586+0000","last_became_peered":"2024-05-10T03:54:18.710586+0000","last_unstale":"2024-05-10T03:54:21.355523+0000","last_undegraded":"2024-05-10T03:54:21.355523+0000","last_fullsized":"2024-05-10T03:54:21.355523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:27:24.417905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.725150+0000","last_change":"2024-05-10T03:54:19.713460+0000","last_active":"2024-05-10T03:54:20.725150+0000","last_peered":"2024-05-10T03:54:20.725150+0000","last_clean":"2024-05-10T03:54:20.725150+0000","last_became_active":"2024-05-10T03:54:19.713164+0000","last_became_peered":"2024-05-10T03:54:19.713164+0000","last_unstale":"2024-05-10T03:54:20.725150+0000","last_undegraded":"2024-05-10T03:54:20.725150+0000","last_fullsized":"2024-05-10T03:54:20.725150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:10:27.195596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726356+0000","last_change":"2024-05-10T03:54:18.715329+0000","last_active":"2024-05-10T03:54:20.726356+0000","last_peered":"2024-05-10T03:54:20.726356+0000","last_clean":"2024-05-10T03:54:20.726356+0000","last_became_active":"2024-05-10T03:54:18.715027+0000","last_became_peered":"2024-05-10T03:54:18.715027+0000","last_unstale":"2024-05-10T03:54:20.726356+0000","last_undegraded":"2024-05-10T03:54:20.726356+0000","last_fullsized":"2024-05-10T03:54:20.726356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:52:38.364564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726227+0000","last_change":"2024-05-10T03:54:19.720671+0000","last_active":"2024-05-10T03:54:20.726227+0000","last_peered":"2024-05-10T03:54:20.726227+0000","last_clean":"2024-05-10T03:54:20.726227+0000","last_became_active":"2024-05-10T03:54:19.720323+0000","last_became_peered":"2024-05-10T03:54:19.720323+0000","last_unstale":"2024-05-10T03:54:20.726227+0000","last_undegraded":"2024-05-10T03:54:20.726227+0000","last_fullsized":"2024-05-10T03:54:20.726227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:21.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355739+0000","last_change":"2024-05-10T03:54:18.712088+0000","last_active":"2024-05-10T03:54:21.355739+0000","last_peered":"2024-05-10T03:54:21.355739+0000","last_clean":"2024-05-10T03:54:21.355739+0000","last_became_active":"2024-05-10T03:54:18.711814+0000","last_became_peered":"2024-05-10T03:54:18.711814+0000","last_unstale":"2024-05-10T03:54:21.355739+0000","last_undegraded":"2024-05-10T03:54:21.355739+0000","last_fullsized":"2024-05-10T03:54:21.355739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:34:30.436556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.355018+0000","last_change":"2024-05-10T03:54:19.715943+0000","last_active":"2024-05-10T03:54:21.355018+0000","last_peered":"2024-05-10T03:54:21.355018+0000","last_clean":"2024-05-10T03:54:21.355018+0000","last_became_active":"2024-05-10T03:54:19.715666+0000","last_became_peered":"2024-05-10T03:54:19.715666+0000","last_unstale":"2024-05-10T03:54:21.355018+0000","last_undegraded":"2024-05-10T03:54:21.355018+0000","last_fullsized":"2024-05-10T03:54:21.355018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:02.174832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726279+0000","last_change":"2024-05-10T03:54:18.711345+0000","last_active":"2024-05-10T03:54:20.726279+0000","last_peered":"2024-05-10T03:54:20.726279+0000","last_clean":"2024-05-10T03:54:20.726279+0000","last_became_active":"2024-05-10T03:54:18.711049+0000","last_became_peered":"2024-05-10T03:54:18.711049+0000","last_unstale":"2024-05-10T03:54:20.726279+0000","last_undegraded":"2024-05-10T03:54:20.726279+0000","last_fullsized":"2024-05-10T03:54:20.726279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:07.180696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.726236+0000","last_change":"2024-05-10T03:54:19.710820+0000","last_active":"2024-05-10T03:54:20.726236+0000","last_peered":"2024-05-10T03:54:20.726236+0000","last_clean":"2024-05-10T03:54:20.726236+0000","last_became_active":"2024-05-10T03:54:19.709902+0000","last_became_peered":"2024-05-10T03:54:19.709902+0000","last_unstale":"2024-05-10T03:54:20.726236+0000","last_undegraded":"2024-05-10T03:54:20.726236+0000","last_fullsized":"2024-05-10T03:54:20.726236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:20:06.087846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354834+0000","last_change":"2024-05-10T03:54:18.713194+0000","last_active":"2024-05-10T03:54:21.354834+0000","last_peered":"2024-05-10T03:54:21.354834+0000","last_clean":"2024-05-10T03:54:21.354834+0000","last_became_active":"2024-05-10T03:54:18.712913+0000","last_became_peered":"2024-05-10T03:54:18.712913+0000","last_unstale":"2024-05-10T03:54:21.354834+0000","last_undegraded":"2024-05-10T03:54:21.354834+0000","last_fullsized":"2024-05-10T03:54:21.354834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:01.165172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354240+0000","last_change":"2024-05-10T03:54:19.722935+0000","last_active":"2024-05-10T03:54:21.354240+0000","last_peered":"2024-05-10T03:54:21.354240+0000","last_clean":"2024-05-10T03:54:21.354240+0000","last_became_active":"2024-05-10T03:54:19.722644+0000","last_became_peered":"2024-05-10T03:54:19.722644+0000","last_unstale":"2024-05-10T03:54:21.354240+0000","last_undegraded":"2024-05-10T03:54:21.354240+0000","last_fullsized":"2024-05-10T03:54:21.354240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:44:56.196605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723450+0000","last_change":"2024-05-10T03:54:18.701202+0000","last_active":"2024-05-10T03:54:20.723450+0000","last_peered":"2024-05-10T03:54:20.723450+0000","last_clean":"2024-05-10T03:54:20.723450+0000","last_became_active":"2024-05-10T03:54:18.700925+0000","last_became_peered":"2024-05-10T03:54:18.700925+0000","last_unstale":"2024-05-10T03:54:20.723450+0000","last_undegraded":"2024-05-10T03:54:20.723450+0000","last_fullsized":"2024-05-10T03:54:20.723450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:11:47.852977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:20.723270+0000","last_change":"2024-05-10T03:54:19.723880+0000","last_active":"2024-05-10T03:54:20.723270+0000","last_peered":"2024-05-10T03:54:20.723270+0000","last_clean":"2024-05-10T03:54:20.723270+0000","last_became_active":"2024-05-10T03:54:19.723250+0000","last_became_peered":"2024-05-10T03:54:19.723250+0000","last_unstale":"2024-05-10T03:54:20.723270+0000","last_undegraded":"2024-05-10T03:54:20.723270+0000","last_fullsized":"2024-05-10T03:54:20.723270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:21.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354314+0000","last_change":"2024-05-10T03:54:18.716999+0000","last_active":"2024-05-10T03:54:21.354314+0000","last_peered":"2024-05-10T03:54:21.354314+0000","last_clean":"2024-05-10T03:54:21.354314+0000","last_became_active":"2024-05-10T03:54:18.716585+0000","last_became_peered":"2024-05-10T03:54:18.716585+0000","last_unstale":"2024-05-10T03:54:21.354314+0000","last_undegraded":"2024-05-10T03:54:21.354314+0000","last_fullsized":"2024-05-10T03:54:21.354314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:56.471486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354617+0000","last_change":"2024-05-10T03:54:19.721072+0000","last_active":"2024-05-10T03:54:21.354617+0000","last_peered":"2024-05-10T03:54:21.354617+0000","last_clean":"2024-05-10T03:54:21.354617+0000","last_became_active":"2024-05-10T03:54:19.720635+0000","last_became_peered":"2024-05-10T03:54:19.720635+0000","last_unstale":"2024-05-10T03:54:21.354617+0000","last_undegraded":"2024-05-10T03:54:21.354617+0000","last_fullsized":"2024-05-10T03:54:21.354617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:18.683195+0000","last_clean_scrub_stamp":"2024-05-10T03:54:18.683195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:48:47.687063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354588+0000","last_change":"2024-05-10T03:54:18.716384+0000","last_active":"2024-05-10T03:54:21.354588+0000","last_peered":"2024-05-10T03:54:21.354588+0000","last_clean":"2024-05-10T03:54:21.354588+0000","last_became_active":"2024-05-10T03:54:18.716102+0000","last_became_peered":"2024-05-10T03:54:18.716102+0000","last_unstale":"2024-05-10T03:54:21.354588+0000","last_undegraded":"2024-05-10T03:54:21.354588+0000","last_fullsized":"2024-05-10T03:54:21.354588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:54:17.673534+0000","last_clean_scrub_stamp":"2024-05-10T03:54:17.673534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:23:38.913527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-10T03:54:21.354842+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:54:21.354842+0000","last_peered":"2024-05-10T03:54:21.354842+0000","last_clean":"2024-05-10T03:54:21.354842+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:21.354842+0000","last_undegraded":"2024-05-10T03:54:21.354842+0000","last_fullsized":"2024-05-10T03:54:21.354842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":724198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":135374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":133810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":135374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":942080,"data_stored":724108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:54:24.141 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T03:54:24.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T03:54:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 Processor -- start 2024-05-10T03:54:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 -- start start 2024-05-10T03:54:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 0x7ff4540b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4540d24c0 0x7ff45406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45415f8e0 con 0x7ff4540b51b0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff4540b5fe0 con 0x7ff4540d24c0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.285+0000 7ff45b159640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540b5610 con 0x7ff45415f500 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff453fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4540b51b0 0x7ff4540d1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54344/0 (socket says 172.21.15.55:54344) 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff453fff640 1 -- 172.21.15.55:0/3991594841 learned_addr learned my addr 172.21.15.55:0/3991594841 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214721274 0 0) 0x7ff45415f8e0 con 0x7ff4540b51b0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff458ef5640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 0x7ff4540b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff444003520 con 0x7ff4540b51b0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4596f6640 1 --2- 172.21.15.55:0/3991594841 >> v2:172.21.15.64:3300/0 conn(0x7ff4540d24c0 0x7ff45406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2013644007 0 0) 0x7ff444003520 con 0x7ff4540b51b0 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 msgr2=0x7ff4540b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 0x7ff4540b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 >> v2:172.21.15.64:3300/0 conn(0x7ff4540d24c0 msgr2=0x7ff45406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 --2- 172.21.15.55:0/3991594841 >> v2:172.21.15.64:3300/0 conn(0x7ff4540d24c0 0x7ff45406e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff454163200 con 0x7ff4540b51b0 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7ff4400016f0 con 0x7ff4540b51b0 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 >> v1:172.21.15.55:6789/0 conn(0x7ff4540b51b0 legacy=0x7ff4540d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff444003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 0x7ff444004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff444004d40 0x7ff4440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff44400b9c0 con 0x7ff444003a00 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff44400bb40 con 0x7ff444004d40 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff44400bcc0 con 0x7ff45415f500 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff458ef5640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff444003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.286+0000 7ff453fff640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 0x7ff444004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff4596f6640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff444004d40 0x7ff4440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff458ef5640 1 -- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 msgr2=0x7ff444004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff458ef5640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415f500 0x7ff444004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff458ef5640 1 -- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff444004d40 msgr2=0x7ff4440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff458ef5640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff444004d40 0x7ff4440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff458ef5640 1 -- 172.21.15.55:0/3991594841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff444003520 con 0x7ff444003a00 2024-05-10T03:54:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.287+0000 7ff458ef5640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff444003e20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff448009ac0 tx=0x7ff444005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca37704f528243bf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448036070 con 0x7ff444003a00 2024-05-10T03:54:24.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff448031400 con 0x7ff444003a00 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff4537fe640 1 -- 172.21.15.55:0/3991594841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448009690 con 0x7ff444003a00 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff45b159640 1 -- 172.21.15.55:0/3991594841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 msgr2=0x7ff444003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff45b159640 1 --2- 172.21.15.55:0/3991594841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff444003e20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff448009ac0 tx=0x7ff444005830 comp rx=0 tx=0).stop 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff4596f6640 1 -- 172.21.15.55:0/3991594841 reap_dead start 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff45b159640 1 -- 172.21.15.55:0/3991594841 shutdown_connections 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff45b159640 1 -- 172.21.15.55:0/3991594841 >> 172.21.15.55:0/3991594841 conn(0x7ff45406c390 msgr2=0x7ff45406c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff45b159640 1 -- 172.21.15.55:0/3991594841 shutdown_connections 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.288+0000 7ff45b159640 1 -- 172.21.15.55:0/3991594841 wait complete. 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.289+0000 7ff45b159640 1 Processor -- start 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.289+0000 7ff45b159640 1 -- start start 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff45b159640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff454156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff45b159640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4540b6350 0x7ff4540b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff45b159640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415b140 0x7ff45415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff45b159640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff454163aa0 con 0x7ff444003a00 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff45b159640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff4541637c0 con 0x7ff4540b6350 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff45b159640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540b4c70 con 0x7ff45415b140 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff458ef5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff454156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff458ef5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff454156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43852/0 (socket says 172.21.15.55:43852) 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.290+0000 7ff458ef5640 1 -- 172.21.15.55:0/1227840085 learned_addr learned my addr 172.21.15.55:0/1227840085 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff453fff640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4540b6350 0x7ff4540b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff4596f6640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415b140 0x7ff45415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff458ef5640 1 -- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415b140 msgr2=0x7ff45415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff458ef5640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415b140 0x7ff45415b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff458ef5640 1 -- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4540b6350 msgr2=0x7ff4540b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff458ef5640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4540b6350 0x7ff4540b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff458ef5640 1 -- 172.21.15.55:0/1227840085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff454160bc0 con 0x7ff444003a00 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff458ef5640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff454156c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff448009ac0 tx=0x7ff448004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448040020 con 0x7ff444003a00 2024-05-10T03:54:24.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff448003bc0 con 0x7ff444003a00 2024-05-10T03:54:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff454157180 con 0x7ff444003a00 2024-05-10T03:54:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448036040 con 0x7ff444003a00 2024-05-10T03:54:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.291+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff454161140 con 0x7ff444003a00 2024-05-10T03:54:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.292+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45406a7e0 con 0x7ff444003a00 2024-05-10T03:54:24.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.293+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff448043020 con 0x7ff444003a00 2024-05-10T03:54:24.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.293+0000 7ff4517fa640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff438076300 0x7ff4380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.293+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff4480b78d0 con 0x7ff444003a00 2024-05-10T03:54:24.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.293+0000 7ff453fff640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff438076300 0x7ff4380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.294+0000 7ff453fff640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff438076300 0x7ff4380787c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff45415b0f0 tx=0x7ff440001c70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:24.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.298+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff44804a030 con 0x7ff444003a00 2024-05-10T03:54:24.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.561+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff4540d0860 con 0x7ff444003a00 2024-05-10T03:54:24.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.568+0000 7ff4517fa640 1 -- 172.21.15.55:0/1227840085 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7ff4480044e0 con 0x7ff444003a00 2024-05-10T03:54:24.572 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-05-10T03:54:24.572 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMmj1ml0IAIBAA93lk8/YccGFOF3TeM3QGRw== 2024-05-10T03:54:24.572 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-05-10T03:54:24.572 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-05-10T03:54:24.572 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-10T03:54:24.572 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff438076300 msgr2=0x7ff4380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff438076300 0x7ff4380787c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff45415b0f0 tx=0x7ff440001c70 comp rx=0 tx=0).stop 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 msgr2=0x7ff454156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff454156c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff448009ac0 tx=0x7ff448004730 comp rx=0 tx=0).stop 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 shutdown_connections 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff45415b140 0x7ff45415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4540b6350 0x7ff4540b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff438076300 0x7ff4380787c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 --2- 172.21.15.55:0/1227840085 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff444003a00 0x7ff454156c40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 >> 172.21.15.55:0/1227840085 conn(0x7ff45406c390 msgr2=0x7ff4540cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:24.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 shutdown_connections 2024-05-10T03:54:24.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.570+0000 7ff45b159640 1 -- 172.21.15.55:0/1227840085 wait complete. 2024-05-10T03:54:24.585 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:24.665 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-05-10T03:54:24.661+0000 7faa4acd1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T03:54:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.684+0000 7ff97f66d640 1 Processor -- start 2024-05-10T03:54:24.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.685+0000 7ff97f66d640 1 -- start start 2024-05-10T03:54:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97f66d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff97815f3d0 0x7ff9780d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97f66d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 0x7ff9780d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97f66d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff978160a10 con 0x7ff9780d3360 2024-05-10T03:54:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97f66d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff978160450 con 0x7ff97815f3d0 2024-05-10T03:54:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97f66d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff978160730 con 0x7ff9780d2980 2024-05-10T03:54:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97d409640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff97815f3d0 0x7ff9780d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97cc08640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 0x7ff9780d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97cc08640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 0x7ff9780d38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:47132/0 (socket says 172.21.15.55:47132) 2024-05-10T03:54:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97d409640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff97815f3d0 0x7ff9780d2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:53860/0 (socket says 172.21.15.55:53860) 2024-05-10T03:54:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97cc08640 1 -- 172.21.15.55:0/1245585894 learned_addr learned my addr 172.21.15.55:0/1245585894 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97dc0a640 1 --1- 172.21.15.55:0/1245585894 >> v1:172.21.15.64:6789/0 conn(0x7ff9780d3360 0x7ff9780b4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:38624/0 (socket says 172.21.15.55:38624) 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff96ffff640 1 -- 172.21.15.55:0/1245585894 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486872188 0 0) 0x7ff978160a10 con 0x7ff9780d3360 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff96ffff640 1 -- 172.21.15.55:0/1245585894 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff964003520 con 0x7ff9780d3360 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97d409640 1 -- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 msgr2=0x7ff9780d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97d409640 1 --2- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 0x7ff9780d38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97d409640 1 -- 172.21.15.55:0/1245585894 >> v1:172.21.15.64:6789/0 conn(0x7ff9780d3360 legacy=0x7ff9780b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97d409640 1 -- 172.21.15.55:0/1245585894 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780d1c40 con 0x7ff97815f3d0 2024-05-10T03:54:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.686+0000 7ff97cc08640 1 --2- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 0x7ff9780d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.687+0000 7ff97d409640 1 --2- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780d2440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31cf374bef32965c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.687+0000 7ff96ffff640 1 -- 172.21.15.55:0/1245585894 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037070 con 0x7ff97815f3d0 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.687+0000 7ff96ffff640 1 -- 172.21.15.55:0/1245585894 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97402ae50 con 0x7ff97815f3d0 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.687+0000 7ff96ffff640 1 -- 172.21.15.55:0/1245585894 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974032640 con 0x7ff97815f3d0 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 -- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 msgr2=0x7ff9780d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 --2- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780d2440 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402a100 comp rx=0 tx=0).stop 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 -- 172.21.15.55:0/1245585894 shutdown_connections 2024-05-10T03:54:24.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 --2- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780d2980 0x7ff9780d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 --2- 172.21.15.55:0/1245585894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780d2440 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 -- 172.21.15.55:0/1245585894 >> 172.21.15.55:0/1245585894 conn(0x7ff97808ed00 msgr2=0x7ff97809e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 -- 172.21.15.55:0/1245585894 shutdown_connections 2024-05-10T03:54:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.688+0000 7ff97f66d640 1 -- 172.21.15.55:0/1245585894 wait complete. 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.689+0000 7ff97f66d640 1 Processor -- start 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.689+0000 7ff97f66d640 1 -- start start 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97f66d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 0x7ff9780b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97f66d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97f66d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780b9c40 0x7ff97806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97f66d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780b57f0 con 0x7ff9780d3360 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97f66d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780b5670 con 0x7ff97815f3d0 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97f66d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff9780cbcb0 con 0x7ff9780b9c40 2024-05-10T03:54:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97d409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 0x7ff9780b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97d409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 0x7ff9780b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43862/0 (socket says 172.21.15.55:43862) 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97d409640 1 -- 172.21.15.55:0/812338676 learned_addr learned my addr 172.21.15.55:0/812338676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97cc08640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.690+0000 7ff97dc0a640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780b9c40 0x7ff97806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97d409640 1 -- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780b9c40 msgr2=0x7ff97806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97d409640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780b9c40 0x7ff97806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97d409640 1 -- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 msgr2=0x7ff9780cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97d409640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97d409640 1 -- 172.21.15.55:0/812338676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780ba420 con 0x7ff9780d3360 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97cc08640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97d409640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 0x7ff9780b2b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff9740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974041020 con 0x7ff9780d3360 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9740044c0 con 0x7ff9780d3360 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037040 con 0x7ff9780d3360 2024-05-10T03:54:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9780ba700 con 0x7ff9780d3360 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.691+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9780bacc0 con 0x7ff9780d3360 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.692+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9780a3290 con 0x7ff9780d3360 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.693+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff974044020 con 0x7ff9780d3360 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.693+0000 7ff96dffb640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff95c0762d0 0x7ff95c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.693+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff9740b7870 con 0x7ff9780d3360 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.693+0000 7ff97cc08640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff95c0762d0 0x7ff95c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.694+0000 7ff97cc08640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff95c0762d0 0x7ff95c078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff968009630 tx=0x7ff968009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.698+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff97404b030 con 0x7ff9780d3360 2024-05-10T03:54:24.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.929+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9780b67f0 con 0x7ff9780d3360 2024-05-10T03:54:24.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.930+0000 7ff96dffb640 1 -- 172.21.15.55:0/812338676 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5175 (secure 0 0 0) 0x7ff974080af0 con 0x7ff9780d3360 2024-05-10T03:54:24.934 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:24.934 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:22.105637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4800":{"gid":4800,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1112724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1112724499},{"type":"v1","addr":"172.21.15.55:6836","nonce":1112724499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4800,"qdb_cluster":[4800]},"id":2}]} 2024-05-10T03:54:24.934 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff95c0762d0 msgr2=0x7ff95c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff95c0762d0 0x7ff95c078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff968009630 tx=0x7ff968009240 comp rx=0 tx=0).stop 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 msgr2=0x7ff9780b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 0x7ff9780b2b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff9740046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 shutdown_connections 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9780b9c40 0x7ff97806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff97815f3d0 0x7ff9780cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff95c0762d0 0x7ff95c078790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 --2- 172.21.15.55:0/812338676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9780d3360 0x7ff9780b2b20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 >> 172.21.15.55:0/812338676 conn(0x7ff97808ed00 msgr2=0x7ff9780d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 shutdown_connections 2024-05-10T03:54:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:24.932+0000 7ff97f66d640 1 -- 172.21.15.55:0/812338676 wait complete. 2024-05-10T03:54:25.349 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T03:54:19.076327+0000', 'modified': '2024-05-10T03:54:22.105637+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4800}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4800': {'gid': 4800, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6836/1112724499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1112724499}, {'type': 'v1', 'addr': '172.21.15.55:6836', 'nonce': 1112724499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4800, 'qdb_cluster': [4800]} 2024-05-10T03:54:25.349 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T03:54:25.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-10T03:54:25.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.453+0000 7fd5ebada640 1 Processor -- start 2024-05-10T03:54:25.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5ebada640 1 -- start start 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5ebada640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5e409c170 0x7fd5e40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5ebada640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e40b5660 0x7fd5e40d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5ebada640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e40cd7d0 con 0x7fd5e40b44c0 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5ebada640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e40b48a0 con 0x7fd5e409c170 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5ebada640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e40cdab0 con 0x7fd5e40b5660 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.454+0000 7fd5e9075640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5e409c170 0x7fd5e40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5e9075640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5e409c170 0x7fd5e40d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43864/0 (socket says 172.21.15.55:43864) 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5e9075640 1 -- 172.21.15.55:0/2222712093 learned_addr learned my addr 172.21.15.55:0/2222712093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5ea077640 1 --2- 172.21.15.55:0/2222712093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e40b5660 0x7fd5e40d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5e9075640 1 -- 172.21.15.55:0/2222712093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e40b5660 msgr2=0x7fd5e40d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2222712093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e40b5660 0x7fd5e40d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5e9075640 1 -- 172.21.15.55:0/2222712093 >> v1:172.21.15.64:6789/0 conn(0x7fd5e40b44c0 legacy=0x7fd5e409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.455+0000 7fd5e9075640 1 -- 172.21.15.55:0/2222712093 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e40cdd90 con 0x7fd5e409c170 2024-05-10T03:54:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2222712093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e409c170 0x7fd5e40d1170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009870 tx=0x7fd5d802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62683f314a7a0459 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5e8874640 1 -- 172.21.15.55:0/2222712093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8037070 con 0x7fd5e409c170 2024-05-10T03:54:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5e8874640 1 -- 172.21.15.55:0/2222712093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8032440 con 0x7fd5e409c170 2024-05-10T03:54:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5e8874640 1 -- 172.21.15.55:0/2222712093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8032810 con 0x7fd5e409c170 2024-05-10T03:54:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 -- 172.21.15.55:0/2222712093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e409c170 msgr2=0x7fd5e40d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 --2- 172.21.15.55:0/2222712093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e409c170 0x7fd5e40d1170 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009870 tx=0x7fd5d802a1c0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 -- 172.21.15.55:0/2222712093 shutdown_connections 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 --2- 172.21.15.55:0/2222712093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e40b5660 0x7fd5e40d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 --2- 172.21.15.55:0/2222712093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e409c170 0x7fd5e40d1170 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 -- 172.21.15.55:0/2222712093 >> 172.21.15.55:0/2222712093 conn(0x7fd5e40b4b40 msgr2=0x7fd5e40b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 -- 172.21.15.55:0/2222712093 shutdown_connections 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.456+0000 7fd5ebada640 1 -- 172.21.15.55:0/2222712093 wait complete. 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 Processor -- start 2024-05-10T03:54:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 -- start start 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e409c170 0x7fd5e4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5e40b44c0 0x7fd5e40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 0x7fd5e40c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e406e310 con 0x7fd5e40b5660 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e406e6b0 con 0x7fd5e40b44c0 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ebada640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e406e490 con 0x7fd5e409c170 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ea077640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 0x7fd5e40c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ea077640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 0x7fd5e40c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43866/0 (socket says 172.21.15.55:43866) 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.458+0000 7fd5ea077640 1 -- 172.21.15.55:0/1860586534 learned_addr learned my addr 172.21.15.55:0/1860586534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e9075640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5e40b44c0 0x7fd5e40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e9876640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e409c170 0x7fd5e4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ea077640 1 -- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e409c170 msgr2=0x7fd5e4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ea077640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e409c170 0x7fd5e4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ea077640 1 -- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5e40b44c0 msgr2=0x7fd5e40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ea077640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5e40b44c0 0x7fd5e40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ea077640 1 -- 172.21.15.55:0/1860586534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e40b5be0 con 0x7fd5e40b5660 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e9075640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5e40b44c0 0x7fd5e40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e9876640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e409c170 0x7fd5e4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:25.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ea077640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 0x7fd5e40c8d10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4007e40 tx=0x7fd5d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e27fc640 1 -- 172.21.15.55:0/1860586534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4014620 con 0x7fd5e40b5660 2024-05-10T03:54:25.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e27fc640 1 -- 172.21.15.55:0/1860586534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d4019070 con 0x7fd5e40b5660 2024-05-10T03:54:25.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e40b5ec0 con 0x7fd5e40b5660 2024-05-10T03:54:25.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5e27fc640 1 -- 172.21.15.55:0/1860586534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4014a20 con 0x7fd5e40b5660 2024-05-10T03:54:25.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.459+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e41529b0 con 0x7fd5e40b5660 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.461+0000 7fd5e27fc640 1 -- 172.21.15.55:0/1860586534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5d4014bc0 con 0x7fd5e40b5660 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.461+0000 7fd5e27fc640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd5d00762d0 0x7fd5d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.461+0000 7fd5e27fc640 1 -- 172.21.15.55:0/1860586534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd5d4097e60 con 0x7fd5e40b5660 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.462+0000 7fd5e9876640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd5d00762d0 0x7fd5d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.462+0000 7fd5e9876640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd5d00762d0 0x7fd5d0078790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc007fd0 tx=0x7fd5dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.462+0000 7fd5ee7fc740 1 Processor -- start 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.462+0000 7fd5ee7fc740 1 -- start start 2024-05-10T03:54:25.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d3c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d3c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d396bb0 0x55ad9d39a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55ad9d3008d0 con 0x55ad9d3c4330 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ad9d2b9c10 con 0x55ad9d396bb0 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55ad9d2fc890 con 0x55ad9d3c3f50 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5e9075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d3c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5e9075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d3c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43878/0 (socket says 172.21.15.55:43878) 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5e9876640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d3c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5e9075640 1 -- 172.21.15.55:0/3745683748 learned_addr learned my addr 172.21.15.55:0/3745683748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5ea077640 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d396bb0 0x55ad9d39a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5e9075640 1 -- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 msgr2=0x55ad9d3c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.463+0000 7fd5e9075640 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d3c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5e9075640 1 -- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d396bb0 msgr2=0x55ad9d39a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5e9075640 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d396bb0 0x55ad9d39a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5e9075640 1 -- 172.21.15.55:0/3745683748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad9d2c15d0 con 0x55ad9d3c4330 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5e9075640 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d3c6ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd5d802a200 tx=0x7fd5d802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6687253ccb206a66 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5cb7fe640 1 -- 172.21.15.55:0/3745683748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8037040 con 0x55ad9d3c4330 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5cb7fe640 1 -- 172.21.15.55:0/3745683748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8032880 con 0x55ad9d3c4330 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5cb7fe640 1 -- 172.21.15.55:0/3745683748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8032c30 con 0x55ad9d3c4330 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/3745683748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 msgr2=0x55ad9d3c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.464+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d3c6ca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd5d802a200 tx=0x7fd5d802c000 comp rx=0 tx=0).stop 2024-05-10T03:54:25.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/3745683748 shutdown_connections 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d396bb0 0x55ad9d39a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d3c6ca0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/3745683748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d3c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/3745683748 >> 172.21.15.55:0/3745683748 conn(0x55ad9d398e20 msgr2=0x55ad9d3e1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/3745683748 shutdown_connections 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/3745683748 wait complete. 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 -- start start 2024-05-10T03:54:25.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.465+0000 7fd5ee7fc740 1 Processor -- start 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d3c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3e7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55ad9d39bfd0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ad9d2bd760 con 0x55ad9d3c4330 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55ad9d39c2b0 con 0x55ad9d3e4250 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ee7fc740 10 client.0 _ll_register_callbacks cb 0x55ad9d2f6cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5e9876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d3c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5e9876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d3c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43882/0 (socket says 172.21.15.55:43882) 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5e9876640 1 -- 172.21.15.55:0/4158776249 learned_addr learned my addr 172.21.15.55:0/4158776249 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5ea077640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.466+0000 7fd5e9075640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9876640 1 -- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 msgr2=0x55ad9d3e46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9876640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9876640 1 -- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 msgr2=0x55ad9d3e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9876640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3e7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9876640 1 -- 172.21.15.55:0/4158776249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad9d0122d0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ea077640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9075640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5e9876640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d3c2b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00ea10 tx=0x7fd5dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a213aa50ec643a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/4158776249 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc027060 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/4158776249 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd5dc010040 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5d8032880 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/4158776249 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd5dc003d80 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 10 client.4962 fetch_fsmap learned FSMap version 17 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55ad9d0dc6b0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/4158776249 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8032880 con 0x55ad9d3c3f50 2024-05-10T03:54:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/4158776249 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fd5dc013420 con 0x55ad9d3c3f50 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 10 client.4962 fetch_fsmap finished waiting for FSMap version 17 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 10 client.4962 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 20 client.4962 populate_metadata read hostname 'smithi055' 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d3c9180 0x55ad9d3c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 4 client.4962 mds_command: new command op to 4800 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.467+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 --> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad9d284760 con 0x55ad9d3c9180 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.468+0000 7fd5e9075640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d3c9180 0x55ad9d3c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.468+0000 7fd5c8ff9640 10 client.4962 ms_handle_connect on v2:172.21.15.55:6834/1112724499 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.468+0000 7fd5e9075640 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d3c9180 0x55ad9d3c9560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3166201589f1c1b server_cookie=670344cb7327b73c in_seq=0 out_seq=0 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.468+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/4158776249 <== mds.0 v2:172.21.15.55:6834/1112724499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ad9d284760 con 0x55ad9d3c9180 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.468+0000 7fd5c8ff9640 10 client.4962 handle_command_reply: tid=0 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.468+0000 7fd5ee7fc740 1 client.4962 shutdown 2024-05-10T03:54:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 msgr2=0x55ad9d3c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d3c2b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00ea10 tx=0x7fd5dc000ed0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 shutdown_connections 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d3c9180 0x55ad9d3c9560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5c8ff9640 0 client.4962 ms_handle_reset on v2:172.21.15.55:6834/1112724499 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/4158776249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d3c2b50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 >> 172.21.15.55:0/4158776249 conn(0x55ad9d396bb0 msgr2=0x55ad9d397860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 shutdown_connections 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/4158776249 wait complete. 2024-05-10T03:54:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.469+0000 7fd5ee7fc740 20 client.4962 trim_cache size 0 max 16384 2024-05-10T03:54:25.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 Processor -- start 2024-05-10T03:54:25.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 -- start start 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d39ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d397560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3e4250 0x55ad9d397aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e4201880 con 0x55ad9d3c4330 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40b8020 con 0x55ad9d3e4250 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e40b7380 con 0x55ad9d3c3f50 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5e9075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d397560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5e9075640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d397560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43890/0 (socket says 172.21.15.55:43890) 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.488+0000 7fd5e9075640 1 -- 172.21.15.55:0/2782882761 learned_addr learned my addr 172.21.15.55:0/2782882761 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5e9075640 1 -- 172.21.15.55:0/2782882761 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 msgr2=0x55ad9d39ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d39ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5e9075640 1 -- 172.21.15.55:0/2782882761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3e4250 msgr2=0x55ad9d397aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3e4250 0x55ad9d397aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5e9075640 1 -- 172.21.15.55:0/2782882761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad9d3c0680 con 0x55ad9d3c4330 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d397560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd5d802a7b0 tx=0x7fd5d8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bb6e28f38e3eb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5caffd640 1 -- 172.21.15.55:0/2782882761 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8037040 con 0x55ad9d3c4330 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5caffd640 1 -- 172.21.15.55:0/2782882761 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8004030 con 0x55ad9d3c4330 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.489+0000 7fd5caffd640 1 -- 172.21.15.55:0/2782882761 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8004420 con 0x55ad9d3c4330 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2782882761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 msgr2=0x55ad9d397560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d397560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd5d802a7b0 tx=0x7fd5d8008030 comp rx=0 tx=0).stop 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2782882761 shutdown_connections 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3e4250 0x55ad9d397aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c4330 0x55ad9d397560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2782882761 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3c3f50 0x55ad9d39ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2782882761 >> 172.21.15.55:0/2782882761 conn(0x55ad9d396bb0 msgr2=0x55ad9d3e46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2782882761 shutdown_connections 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2782882761 wait complete. 2024-05-10T03:54:25.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 -- start start 2024-05-10T03:54:25.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.490+0000 7fd5ee7fc740 1 Processor -- start 2024-05-10T03:54:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d397480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3979c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55ad9d3e8ed0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40b79d0 con 0x55ad9d3c4330 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55ad9d3e9510 con 0x55ad9d3e4250 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ee7fc740 10 client.0 _ll_register_callbacks cb 0x7fd5dc001480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5e9876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d397480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5e9876640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d397480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43900/0 (socket says 172.21.15.55:43900) 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5e9876640 1 -- 172.21.15.55:0/2028835401 learned_addr learned my addr 172.21.15.55:0/2028835401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.491+0000 7fd5ea077640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5e9876640 1 -- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 msgr2=0x55ad9d3e2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5e9876640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5e9876640 1 -- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 msgr2=0x55ad9d3979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5e9876640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5e9876640 1 -- 172.21.15.55:0/2028835401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad9d3d7ef0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5e9876640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d397480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000f10 tx=0x7fd5dc005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db9deef94d0560e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/2028835401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc031020 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/2028835401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd5dc0247c0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5d8004030 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/2028835401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd5dc0054b0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 10 client.4968 fetch_fsmap learned FSMap version 17 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55ad9d3e5d20 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/2028835401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8004030 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/2028835401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fd5dc0249c0 con 0x55ad9d3c3f50 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 10 client.4968 fetch_fsmap finished waiting for FSMap version 17 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 10 client.4968 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 20 client.4968 populate_metadata read hostname 'smithi055' 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d395a40 0x55ad9d395e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 4 client.4968 mds_command: new command op to 4800 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.492+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 --> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] -- command(tid 0: {"prefix": "status"}) -- 0x55ad9d30e4e0 con 0x55ad9d395a40 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d395a40 0x55ad9d395e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5c8ff9640 10 client.4968 ms_handle_connect on v2:172.21.15.55:6834/1112724499 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5e9075640 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d395a40 0x55ad9d395e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c39aa8e2af87d4 server_cookie=c117fffa18f042d2 in_seq=0 out_seq=0 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5c8ff9640 1 -- 172.21.15.55:0/2028835401 <== mds.0 v2:172.21.15.55:6834/1112724499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55ad9d30e4e0 con 0x55ad9d395a40 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5c8ff9640 10 client.4968 handle_command_reply: tid=0 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 client.4968 shutdown 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 msgr2=0x55ad9d397480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d397480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc000f10 tx=0x7fd5dc005000 comp rx=0 tx=0).stop 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 shutdown_connections 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:6834/1112724499,v1:172.21.15.55:6836/1112724499] conn(0x55ad9d395a40 0x55ad9d395e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ad9d3e4250 0x55ad9d3e2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ad9d3c4330 0x55ad9d3979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5c8ff9640 0 client.4968 ms_handle_reset on v2:172.21.15.55:6834/1112724499 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 --2- 172.21.15.55:0/2028835401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad9d3c3f50 0x55ad9d397480 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 >> 172.21.15.55:0/2028835401 conn(0x55ad9d396bb0 msgr2=0x55ad9d3c6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 shutdown_connections 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 1 -- 172.21.15.55:0/2028835401 wait complete. 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.493+0000 7fd5ee7fc740 20 client.4968 trim_cache size 0 max 16384 2024-05-10T03:54:25.503 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "799093e3-fb07-47b3-97e4-8d13003c3bca", 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4800, 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.8013578450000001, 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 17, 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 31, 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 31, 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.699634413 2024-05-10T03:54:25.504 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd5d00762d0 msgr2=0x7fd5d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd5d00762d0 0x7fd5d0078790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc007fd0 tx=0x7fd5dc009040 comp rx=0 tx=0).stop 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 msgr2=0x7fd5e40c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 0x7fd5e40c8d10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4007e40 tx=0x7fd5d400e4b0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 shutdown_connections 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd5d00762d0 0x7fd5d0078790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5e40b5660 0x7fd5e40c8d10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd5e40b44c0 0x7fd5e40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 --2- 172.21.15.55:0/1860586534 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd5e409c170 0x7fd5e4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 >> 172.21.15.55:0/1860586534 conn(0x7fd5e40b4b40 msgr2=0x7fd5e40d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 shutdown_connections 2024-05-10T03:54:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.494+0000 7fd5ebada640 1 -- 172.21.15.55:0/1860586534 wait complete. 2024-05-10T03:54:25.509 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T03:54:25.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.608+0000 7f8678bc9640 1 Processor -- start 2024-05-10T03:54:25.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.608+0000 7f8678bc9640 1 -- start start 2024-05-10T03:54:25.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8678bc9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8678bc9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8674160370 0x7f86740b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8678bc9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86741607b0 con 0x7f86740b4c50 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8678bc9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f867406f250 con 0x7f8674160370 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8678bc9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f867406f530 con 0x7f86740b0eb0 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8674160370 0x7f86740b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8674160370 0x7f86740b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34186/0 (socket says 172.21.15.55:34186) 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 -- 172.21.15.55:0/2379607167 learned_addr learned my addr 172.21.15.55:0/2379607167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f867259c640 1 --2- 172.21.15.55:0/2379607167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 -- 172.21.15.55:0/2379607167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 msgr2=0x7f867406ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 --2- 172.21.15.55:0/2379607167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867406ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 -- 172.21.15.55:0/2379607167 >> v1:172.21.15.64:6789/0 conn(0x7f86740b4c50 legacy=0x7f86741559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.609+0000 7f8671d9b640 1 -- 172.21.15.55:0/2379607167 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867406f810 con 0x7f8674160370 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.610+0000 7f8671d9b640 1 --2- 172.21.15.55:0/2379607167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f86740b4710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8668009870 tx=0x7f866802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3e869292f3a356 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.610+0000 7f867159a640 1 -- 172.21.15.55:0/2379607167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668037070 con 0x7f8674160370 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.610+0000 7f867159a640 1 -- 172.21.15.55:0/2379607167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8668032440 con 0x7f8674160370 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.610+0000 7f867159a640 1 -- 172.21.15.55:0/2379607167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668032810 con 0x7f8674160370 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 -- 172.21.15.55:0/2379607167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 msgr2=0x7f86740b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 --2- 172.21.15.55:0/2379607167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f86740b4710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8668009870 tx=0x7f866802a1c0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 -- 172.21.15.55:0/2379607167 shutdown_connections 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 --2- 172.21.15.55:0/2379607167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f86740b4710 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 --2- 172.21.15.55:0/2379607167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867406ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 -- 172.21.15.55:0/2379607167 >> 172.21.15.55:0/2379607167 conn(0x7f86740d1760 msgr2=0x7f86740d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 -- 172.21.15.55:0/2379607167 shutdown_connections 2024-05-10T03:54:25.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.611+0000 7f8678bc9640 1 -- 172.21.15.55:0/2379607167 wait complete. 2024-05-10T03:54:25.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.612+0000 7f8678bc9640 1 Processor -- start 2024-05-10T03:54:25.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.612+0000 7f8678bc9640 1 -- start start 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8678bc9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8678bc9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86740b4c50 0x7f867415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8678bc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f867415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8678bc9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8674156270 con 0x7f8674160370 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8678bc9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f86741560f0 con 0x7f86740b4c50 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8678bc9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f86741563f0 con 0x7f86740b0eb0 2024-05-10T03:54:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f867415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8672d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f867415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34188/0 (socket says 172.21.15.55:34188) 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8672d9d640 1 -- 172.21.15.55:0/1684841387 learned_addr learned my addr 172.21.15.55:0/1684841387 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f867259c640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.613+0000 7f8671d9b640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86740b4c50 0x7f867415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8672d9d640 1 -- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 msgr2=0x7f867414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8672d9d640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8672d9d640 1 -- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86740b4c50 msgr2=0x7f867415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8672d9d640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86740b4c50 0x7f867415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8672d9d640 1 -- 172.21.15.55:0/1684841387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8674155170 con 0x7f8674160370 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8672d9d640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f867415ea10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c780 tx=0x7f866c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c004b60 con 0x7f8674160370 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c004d00 con 0x7f8674160370 2024-05-10T03:54:25.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8674153030 con 0x7f8674160370 2024-05-10T03:54:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866c00aa90 con 0x7f8674160370 2024-05-10T03:54:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.614+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86741535f0 con 0x7f8674160370 2024-05-10T03:54:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.615+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867406a7e0 con 0x7f8674160370 2024-05-10T03:54:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.616+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f866c00ac30 con 0x7f8674160370 2024-05-10T03:54:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.616+0000 7f8662ffd640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8654076300 0x7f86540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.616+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f866c0979f0 con 0x7f8674160370 2024-05-10T03:54:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.616+0000 7f867259c640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8654076300 0x7f86540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.617+0000 7f867259c640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8654076300 0x7f86540787c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8664006fd0 tx=0x7f8664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:25.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.620+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f866c060c70 con 0x7f8674160370 2024-05-10T03:54:25.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.851+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f867414f7d0 con 0x7f8674160370 2024-05-10T03:54:25.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.852+0000 7f8662ffd640 1 -- 172.21.15.55:0/1684841387 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f866c064f70 con 0x7f8674160370 2024-05-10T03:54:25.856 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T03:54:25.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.853+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8654076300 msgr2=0x7f86540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.853+0000 7f8678bc9640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8654076300 0x7f86540787c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8664006fd0 tx=0x7f8664008040 comp rx=0 tx=0).stop 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 msgr2=0x7f867415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f867415ea10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f866c00c780 tx=0x7f866c00cc40 comp rx=0 tx=0).stop 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 shutdown_connections 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8654076300 0x7f86540787c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8674160370 0x7f867415ea10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86740b4c50 0x7f867415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 --2- 172.21.15.55:0/1684841387 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f86740b0eb0 0x7f867414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 >> 172.21.15.55:0/1684841387 conn(0x7f86740d1760 msgr2=0x7f867406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 shutdown_connections 2024-05-10T03:54:25.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:25.854+0000 7f8678bc9640 1 -- 172.21.15.55:0/1684841387 wait complete. 2024-05-10T03:54:25.868 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T03:54:25.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T03:54:25.868 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-05-10T03:54:25.868 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T03:54:25.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T03:54:25.869 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T03:54:25.869 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T03:54:25.869 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T03:54:25.869 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:54:25.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:25.869 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-05-10T03:54:25.885 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:25.886 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:25.887 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1e:6e:61:be:b2:87 brd ff:ff:ff:ff:ff:ff 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::eca8:a3ff:fea7:50a3/64 scope link 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 86:b8:f9:2b:b4:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T03:54:25.888 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::84b8:f9ff:fe2b:b4cd/64 scope link 2024-05-10T03:54:25.889 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.889 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T03:54:25.889 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 1e:6e:61:be:b2:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T03:54:25.889 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::1c6e:61ff:febe:b287/64 scope link 2024-05-10T03:54:25.889 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-10T03:54:25.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:25.889 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T03:54:25.950 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-05-10T03:54:25.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:25.951 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-05-10T03:54:26.008 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-05-10T03:54:26.008 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T03:54:26.008 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T03:54:26.008 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T03:54:26.008 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T03:54:26.008 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T03:54:26.008 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-10T03:54:26.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T03:54:26.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T03:54:26.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T03:54:26.009 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-10T03:54:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T03:54:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:26.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:26.138 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:54:26.154 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T03:54:26.154 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T03:54:26.155 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:54:26.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:26.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-05-10T03:54:26.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:54:26.221 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T03:54:26.277 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T03:54:26.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T03:54:26.277 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T03:54:26.332 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T03:54:26.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:26.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:54:26.417 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:54:26.417 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T03:54:26.418 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:54:26.426 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:54:26.426 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T03:54:26.426 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:54:26.427 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:54:26.427 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:54:26.432 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T03:54:26.432 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T03:54:26.432 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.64:3300,172.21.15.64:3301" 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790" 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=799093e3-fb07-47b3-97e4-8d13003c3bca" will pass to kernel 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-05-10T03:54:26.433 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T03:54:26.434 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T03:54:26.434 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T03:54:26.435 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T03:54:26.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:26.435 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T03:54:26.461 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T03:54:26.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T03:54:26.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:26.564 INFO:teuthology.orchestra.run.smithi055.stdout:client4768 2024-05-10T03:54:26.564 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:26.564 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:26.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:26.581 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir mydir) 2024-05-10T03:54:26.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:26.642 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch mydir/alpha) 2024-05-10T03:54:26.700 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-05-10T03:54:26.700 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-05-10T03:54:26.700 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-05-10T03:54:26.700 DEBUG:teuthology.orchestra.run.smithi055:> 2024-05-10T03:54:26.700 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir").st_ino) 2024-05-10T03:54:26.700 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-05-10T03:54:26.808 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-05-10T03:54:26.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:26.817 DEBUG:teuthology.orchestra.run.smithi055:> stdin-killer -- python3 -c ' 2024-05-10T03:54:26.817 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-05-10T03:54:26.818 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-05-10T03:54:26.818 DEBUG:teuthology.orchestra.run.smithi055:> 2024-05-10T03:54:26.818 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir/alpha").st_ino) 2024-05-10T03:54:26.818 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-05-10T03:54:26.925 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-05-10T03:54:26.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T03:54:26.935 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:26.935 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:26.992 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:26.992 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:27.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T03:54:27.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.188+0000 7fdc97987640 1 Processor -- start 2024-05-10T03:54:27.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.188+0000 7fdc97987640 1 -- start start 2024-05-10T03:54:27.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc97987640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc900b44c0 0x7fdc9009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc97987640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc900cd7d0 con 0x7fdc900b5660 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc97987640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc900cdab0 con 0x7fdc900d2180 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc97987640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fdc900b48a0 con 0x7fdc900b44c0 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc95723640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc900b44c0 0x7fdc9009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc94f22640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc900b5660 0x7fdc900ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41494/0 (socket says 172.21.15.55:41494) 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.189+0000 7fdc94f22640 1 -- 172.21.15.55:0/4199696302 learned_addr learned my addr 172.21.15.55:0/4199696302 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.190+0000 7fdc95723640 1 -- 172.21.15.55:0/4199696302 >> v1:172.21.15.64:6789/0 conn(0x7fdc900d2180 legacy=0x7fdc900ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.190+0000 7fdc95723640 1 -- 172.21.15.55:0/4199696302 >> v1:172.21.15.55:6789/0 conn(0x7fdc900b5660 legacy=0x7fdc900ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.190+0000 7fdc95723640 1 -- 172.21.15.55:0/4199696302 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc900cdd90 con 0x7fdc900b44c0 2024-05-10T03:54:27.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.190+0000 7fdc8ffff640 1 -- 172.21.15.55:0/4199696302 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485874428 0 0) 0x7fdc900cd7d0 con 0x7fdc900b5660 2024-05-10T03:54:27.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.190+0000 7fdc95723640 1 --2- 172.21.15.55:0/4199696302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b44c0 0x7fdc9009ba60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdc880097a0 tx=0x7fdc8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6d6aebdf5b0f6d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc8ffff640 1 -- 172.21.15.55:0/4199696302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88037070 con 0x7fdc900b44c0 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc8ffff640 1 -- 172.21.15.55:0/4199696302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc88032440 con 0x7fdc900b44c0 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc8ffff640 1 -- 172.21.15.55:0/4199696302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc88032810 con 0x7fdc900b44c0 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 -- 172.21.15.55:0/4199696302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b44c0 msgr2=0x7fdc9009ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 --2- 172.21.15.55:0/4199696302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b44c0 0x7fdc9009ba60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdc880097a0 tx=0x7fdc8802a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 -- 172.21.15.55:0/4199696302 shutdown_connections 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 --2- 172.21.15.55:0/4199696302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b44c0 0x7fdc9009ba60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 -- 172.21.15.55:0/4199696302 >> 172.21.15.55:0/4199696302 conn(0x7fdc900b4b40 msgr2=0x7fdc900b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 -- 172.21.15.55:0/4199696302 shutdown_connections 2024-05-10T03:54:27.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.191+0000 7fdc97987640 1 -- 172.21.15.55:0/4199696302 wait complete. 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.192+0000 7fdc97987640 1 Processor -- start 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.192+0000 7fdc97987640 1 -- start start 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc97987640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc900b44c0 0x7fdc90153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc97987640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 0x7fdc900c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc97987640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc900d2180 0x7fdc900ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc97987640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9006e310 con 0x7fdc900b5660 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc97987640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9006e6b0 con 0x7fdc900d2180 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc97987640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9006e490 con 0x7fdc900b44c0 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc94f22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 0x7fdc900c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc94f22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 0x7fdc900c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34214/0 (socket says 172.21.15.55:34214) 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc94f22640 1 -- 172.21.15.55:0/224975353 learned_addr learned my addr 172.21.15.55:0/224975353 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc95723640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc900b44c0 0x7fdc90153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.193+0000 7fdc95f24640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc900d2180 0x7fdc900ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc94f22640 1 -- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc900b44c0 msgr2=0x7fdc90153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc94f22640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc900b44c0 0x7fdc90153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc94f22640 1 -- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc900d2180 msgr2=0x7fdc900ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc94f22640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc900d2180 0x7fdc900ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc94f22640 1 -- 172.21.15.55:0/224975353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc900ca820 con 0x7fdc900b5660 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc94f22640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 0x7fdc900c7c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400c3d0 tx=0x7fdc8400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840074e0 con 0x7fdc900b5660 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc840047e0 con 0x7fdc900b5660 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc900cab00 con 0x7fdc900b5660 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84004bd0 con 0x7fdc900b5660 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.194+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc900cb0c0 con 0x7fdc900b5660 2024-05-10T03:54:27.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.195+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9006a7e0 con 0x7fdc900b5660 2024-05-10T03:54:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.196+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc84011070 con 0x7fdc900b5660 2024-05-10T03:54:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.196+0000 7fdc8dffb640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fdc7c076300 0x7fdc7c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.196+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdc84097060 con 0x7fdc900b5660 2024-05-10T03:54:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.196+0000 7fdc95723640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fdc7c076300 0x7fdc7c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.197+0000 7fdc95723640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fdc7c076300 0x7fdc7c0787c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc88034000 tx=0x7fdc8802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.201+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc84060370 con 0x7fdc900b5660 2024-05-10T03:54:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.403+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdc900d2dc0 con 0x7fdc900b5660 2024-05-10T03:54:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.403+0000 7fdc8dffb640 1 -- 172.21.15.55:0/224975353 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) ==== 80+0+0 (secure 0 0 0) 0x7fdc84064670 con 0x7fdc900b5660 2024-05-10T03:54:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fdc7c076300 msgr2=0x7fdc7c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fdc7c076300 0x7fdc7c0787c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc88034000 tx=0x7fdc8802e000 comp rx=0 tx=0).stop 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 msgr2=0x7fdc900c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 0x7fdc900c7c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400c3d0 tx=0x7fdc8400c890 comp rx=0 tx=0).stop 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 shutdown_connections 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc900d2180 0x7fdc900ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fdc7c076300 0x7fdc7c0787c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc900b5660 0x7fdc900c7c70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 --2- 172.21.15.55:0/224975353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc900b44c0 0x7fdc90153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 >> 172.21.15.55:0/224975353 conn(0x7fdc900b4b40 msgr2=0x7fdc900b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 shutdown_connections 2024-05-10T03:54:27.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.406+0000 7fdc97987640 1 -- 172.21.15.55:0/224975353 wait complete. 2024-05-10T03:54:27.420 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T03:54:27.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:27.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T03:54:27.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:54:27.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:27.468 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T03:54:27.494 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-10T03:54:27.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.573+0000 7f54cdb1cf40 1 Processor -- start 2024-05-10T03:54:27.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.573+0000 7f54cdb1cf40 1 -- start start 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cdb1cf40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e6e3fb0 0x55fb4e7b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cdb1cf40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e7baac0 0x55fb4e7b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cdb1cf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cdb1cf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55fb4e7bb810 con 0x55fb4e7baea0 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cdb1cf40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fb4e68cf50 con 0x55fb4e7baac0 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cdb1cf40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55fb4e6e4900 con 0x55fb4e6e3fb0 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34230/0 (socket says 172.21.15.55:34230) 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 -- 172.21.15.55:0/4158743524 learned_addr learned my addr 172.21.15.55:0/4158743524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54c3fff640 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e7baac0 0x55fb4e7b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cabb2640 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e6e3fb0 0x55fb4e7b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 -- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e6e3fb0 msgr2=0x55fb4e7b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e6e3fb0 0x55fb4e7b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 -- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e7baac0 msgr2=0x55fb4e7b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e7baac0 0x55fb4e7b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.574+0000 7f54cb3b3640 1 -- 172.21.15.55:0/4158743524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4e7b24e0 con 0x55fb4e7baea0 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cb3b3640 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7103d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54c400a4b0 tx=0x7f54c400a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48637103cfbd093 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54c9bb0640 1 -- 172.21.15.55:0/4158743524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4015070 con 0x55fb4e7baea0 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54c9bb0640 1 -- 172.21.15.55:0/4158743524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c400e710 con 0x55fb4e7baea0 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54c9bb0640 1 -- 172.21.15.55:0/4158743524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c400eae0 con 0x55fb4e7baea0 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/4158743524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 msgr2=0x55fb4e7103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7103d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54c400a4b0 tx=0x7f54c400a970 comp rx=0 tx=0).stop 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/4158743524 shutdown_connections 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7103d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e7baac0 0x55fb4e7b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/4158743524 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e6e3fb0 0x55fb4e7b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/4158743524 >> 172.21.15.55:0/4158743524 conn(0x55fb4e711bd0 msgr2=0x55fb4e711fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/4158743524 shutdown_connections 2024-05-10T03:54:27.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.575+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/4158743524 wait complete. 2024-05-10T03:54:27.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.576+0000 7f54cdb1cf40 1 Processor -- start 2024-05-10T03:54:27.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.576+0000 7f54cdb1cf40 1 -- start start 2024-05-10T03:54:27.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e6e3fb0 0x55fb4e7ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e7baac0 0x55fb4e710d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55fb4e6e5b00 con 0x55fb4e7baea0 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55fb4e6e58b0 con 0x55fb4e6e3fb0 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55fb4e72c3a0 con 0x55fb4e7baac0 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34246/0 (socket says 172.21.15.55:34246) 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 -- 172.21.15.55:0/716583783 learned_addr learned my addr 172.21.15.55:0/716583783 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54c3fff640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e7baac0 0x55fb4e710d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cabb2640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e6e3fb0 0x55fb4e7ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 -- 172.21.15.55:0/716583783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e7baac0 msgr2=0x55fb4e710d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55fb4e7baac0 0x55fb4e710d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 -- 172.21.15.55:0/716583783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e6e3fb0 msgr2=0x55fb4e7ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55fb4e6e3fb0 0x55fb4e7ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 -- 172.21.15.55:0/716583783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4e7a82b0 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cb3b3640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7aca10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54c400ae70 tx=0x7f54c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54c8bae640 1 -- 172.21.15.55:0/716583783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c401f030 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54c8bae640 1 -- 172.21.15.55:0/716583783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c4024410 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb4e7a8590 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54c8bae640 1 -- 172.21.15.55:0/716583783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4015040 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.577+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb4e7a8b50 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.579+0000 7f54c8bae640 1 -- 172.21.15.55:0/716583783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f54c4022030 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.579+0000 7f54c8bae640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54ac074cb0 0x7f54ac077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54cabb2640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54ac074cb0 0x7f54ac077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54c8bae640 1 -- 172.21.15.55:0/716583783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f54c4097660 con 0x55fb4e7baea0 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55fb4e7112c0 0x55fb4e7ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fb4e7a9350 con 0x55fb4e7112c0 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54c3fff640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55fb4e7112c0 0x55fb4e7ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54cabb2640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54ac074cb0 0x7f54ac077170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55fb4e716320 tx=0x7f54bc005940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54c3fff640 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55fb4e7112c0 0x55fb4e7ad460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54c3fff640 1 -- 172.21.15.55:0/716583783 <== osd.3 v2:172.21.15.55:6808/600411321 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f54b4052830 con 0x55fb4e7112c0 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55fb4e7112c0 msgr2=0x55fb4e7ad460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.580+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55fb4e7112c0 0x55fb4e7ad460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54ac074cb0 msgr2=0x7f54ac077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f54ac074cb0 0x7f54ac077170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55fb4e716320 tx=0x7f54bc005940 comp rx=0 tx=0).stop 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 msgr2=0x55fb4e7aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 --2- 172.21.15.55:0/716583783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fb4e7baea0 0x55fb4e7aca10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54c400ae70 tx=0x7f54c4003330 comp rx=0 tx=0).stop 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cb3b3640 1 -- 172.21.15.55:0/716583783 reap_dead start 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 shutdown_connections 2024-05-10T03:54:27.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 >> 172.21.15.55:0/716583783 conn(0x55fb4e711bd0 msgr2=0x55fb4e711fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 shutdown_connections 2024-05-10T03:54:27.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.581+0000 7f54cdb1cf40 1 -- 172.21.15.55:0/716583783 wait complete. 2024-05-10T03:54:27.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:54:27.590 ERROR:tasks.cephfs.filesystem:Command failed on smithi055 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-05-10T03:54:27.590 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T03:54:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.671+0000 7f0c63574f40 1 Processor -- start 2024-05-10T03:54:27.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.671+0000 7f0c63574f40 1 -- start start 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c63574f40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c63574f40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a176d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c63574f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 0x557e9a223170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c63574f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x557e9a17a9d0 con 0x557e9a2215b0 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c63574f40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557e9a0f2f50 con 0x557e9a220ac0 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c63574f40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x557e9a1497f0 con 0x557e9a17a520 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c6186f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 0x557e9a223170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c6186f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 0x557e9a223170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34276/0 (socket says 172.21.15.55:34276) 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c6186f640 1 -- 172.21.15.55:0/1248455280 learned_addr learned my addr 172.21.15.55:0/1248455280 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c6106e640 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.672+0000 7f0c5bfff640 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a176d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c6186f640 1 -- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a17a520 msgr2=0x557e9a177fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c6186f640 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c6186f640 1 -- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 msgr2=0x557e9a176d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c6186f640 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a176d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c6186f640 1 -- 172.21.15.55:0/1248455280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9a223e60 con 0x557e9a2215b0 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c6186f640 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 0x557e9a223170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0259d0 tx=0x7f0c5c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68eaa196e484ae83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c5b7fe640 1 -- 172.21.15.55:0/1248455280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c054040 con 0x557e9a2215b0 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c5b7fe640 1 -- 172.21.15.55:0/1248455280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5c0508a0 con 0x557e9a2215b0 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c5b7fe640 1 -- 172.21.15.55:0/1248455280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c050c70 con 0x557e9a2215b0 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 -- 172.21.15.55:0/1248455280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 msgr2=0x557e9a223170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 0x557e9a223170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0259d0 tx=0x7f0c5c050000 comp rx=0 tx=0).stop 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 -- 172.21.15.55:0/1248455280 shutdown_connections 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a2215b0 0x557e9a223170 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a176d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1248455280 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 -- 172.21.15.55:0/1248455280 >> 172.21.15.55:0/1248455280 conn(0x557e9a177bd0 msgr2=0x557e9a220ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 -- 172.21.15.55:0/1248455280 shutdown_connections 2024-05-10T03:54:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.673+0000 7f0c63574f40 1 -- 172.21.15.55:0/1248455280 wait complete. 2024-05-10T03:54:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.674+0000 7f0c63574f40 1 Processor -- start 2024-05-10T03:54:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.674+0000 7f0c63574f40 1 -- start start 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c63574f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c63574f40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a2119b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c63574f40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a2215b0 0x557e9a176b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c63574f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x557e9a2229a0 con 0x557e9a17a520 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c63574f40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x557e9a222c40 con 0x557e9a220ac0 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c63574f40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x557e9a1784f0 con 0x557e9a2215b0 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a17a520 0x557e9a177fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34284/0 (socket says 172.21.15.55:34284) 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 -- 172.21.15.55:0/1099545806 learned_addr learned my addr 172.21.15.55:0/1099545806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c5bfff640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a2119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6186f640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a2215b0 0x557e9a176b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 -- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a2215b0 msgr2=0x557e9a176b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x557e9a2215b0 0x557e9a176b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 -- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 msgr2=0x557e9a2119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x557e9a220ac0 0x557e9a2119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 -- 172.21.15.55:0/1099545806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9a191f60 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c6106e640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a17a520 0x557e9a177fb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c54007ed0 tx=0x7f0c54006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.675+0000 7f0c5a7fc640 1 -- 172.21.15.55:0/1099545806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54018070 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.676+0000 7f0c5a7fc640 1 -- 172.21.15.55:0/1099545806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c54011700 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.676+0000 7f0c5a7fc640 1 -- 172.21.15.55:0/1099545806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011ab0 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.676+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e9a21a7a0 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.676+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9a194930 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.677+0000 7f0c5a7fc640 1 -- 172.21.15.55:0/1099545806 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c5401b070 con 0x557e9a17a520 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.677+0000 7f0c5a7fc640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0c44074ce0 0x7f0c440771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c5bfff640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0c44074ce0 0x7f0c440771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c5a7fc640 1 -- 172.21.15.55:0/1099545806 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0c54095570 con 0x557e9a17a520 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x557e9a2c25d0 0x557e9a2c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 --> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557e9a2c4f00 con 0x557e9a2c25d0 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c5bfff640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0c44074ce0 0x7f0c440771a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x557e9a191930 tx=0x7f0c4c003910 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c6186f640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x557e9a2c25d0 0x557e9a2c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.678+0000 7f0c6186f640 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x557e9a2c25d0 0x557e9a2c49c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c6186f640 1 -- 172.21.15.55:0/1099545806 <== osd.5 v2:172.21.15.64:6808/3692026818 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f0c5c056030 con 0x557e9a2c25d0 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x557e9a2c25d0 msgr2=0x557e9a2c49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x557e9a2c25d0 0x557e9a2c49c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0c44074ce0 msgr2=0x7f0c440771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0c44074ce0 0x7f0c440771a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x557e9a191930 tx=0x7f0c4c003910 comp rx=0 tx=0).stop 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a17a520 msgr2=0x557e9a177fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 --2- 172.21.15.55:0/1099545806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557e9a17a520 0x557e9a177fb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c54007ed0 tx=0x7f0c54006750 comp rx=0 tx=0).stop 2024-05-10T03:54:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c6186f640 1 -- 172.21.15.55:0/1099545806 reap_dead start 2024-05-10T03:54:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 shutdown_connections 2024-05-10T03:54:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 >> 172.21.15.55:0/1099545806 conn(0x557e9a177bd0 msgr2=0x557e9a221990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 shutdown_connections 2024-05-10T03:54:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.679+0000 7f0c63574f40 1 -- 172.21.15.55:0/1099545806 wait complete. 2024-05-10T03:54:27.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:54:27.688 ERROR:tasks.cephfs.filesystem:Command failed on smithi055 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-05-10T03:54:27.688 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.729+0000 7ff534923f40 1 Processor -- start 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.729+0000 7ff534923f40 1 -- start start 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff534923f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba4c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff534923f40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2ba4a7f0 0x562e2ba48b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff534923f40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2b9c00e0 0x562e2b99f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff534923f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x562e2b9bf930 con 0x562e2b9a5520 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff534923f40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562e2b91df50 con 0x562e2ba4a7f0 2024-05-10T03:54:27.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff534923f40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x562e2b9bfbd0 con 0x562e2b9c00e0 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba4c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba4c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34302/0 (socket says 172.21.15.55:34302) 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 -- 172.21.15.55:0/148494164 learned_addr learned my addr 172.21.15.55:0/148494164 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff532152640 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2b9c00e0 0x562e2b99f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 -- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2b9c00e0 msgr2=0x562e2b99f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff52bfff640 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2ba4a7f0 0x562e2ba48b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2b9c00e0 0x562e2b99f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 -- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2ba4a7f0 msgr2=0x562e2ba48b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2ba4a7f0 0x562e2ba48b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.730+0000 7ff531951640 1 -- 172.21.15.55:0/148494164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2b9a2a00 con 0x562e2b9a5520 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff531951640 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba4c0e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff524025c00 tx=0x7ff52404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a81021aad5ec9a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff53094f640 1 -- 172.21.15.55:0/148494164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524065070 con 0x562e2b9a5520 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff53094f640 1 -- 172.21.15.55:0/148494164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5240549f0 con 0x562e2b9a5520 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff53094f640 1 -- 172.21.15.55:0/148494164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524059040 con 0x562e2b9a5520 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 -- 172.21.15.55:0/148494164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 msgr2=0x562e2ba4c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba4c0e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff524025c00 tx=0x7ff52404e000 comp rx=0 tx=0).stop 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 -- 172.21.15.55:0/148494164 shutdown_connections 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2b9c00e0 0x562e2b99f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2ba4a7f0 0x562e2ba48b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 --2- 172.21.15.55:0/148494164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba4c0e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 -- 172.21.15.55:0/148494164 >> 172.21.15.55:0/148494164 conn(0x562e2b9a2bd0 msgr2=0x562e2ba4b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 -- 172.21.15.55:0/148494164 shutdown_connections 2024-05-10T03:54:27.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.731+0000 7ff534923f40 1 -- 172.21.15.55:0/148494164 wait complete. 2024-05-10T03:54:27.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.732+0000 7ff534923f40 1 Processor -- start 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.732+0000 7ff534923f40 1 -- start start 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.732+0000 7ff534923f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba41b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.732+0000 7ff534923f40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2b9c00e0 0x562e2ba46dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff534923f40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2ba4a7f0 0x562e2b99f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff534923f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x562e2b9a2720 con 0x562e2b9a5520 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff534923f40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x562e2ba422c0 con 0x562e2b9c00e0 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff534923f40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x562e2b9a3050 con 0x562e2ba4a7f0 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba41b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba41b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34308/0 (socket says 172.21.15.55:34308) 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 -- 172.21.15.55:0/3984173790 learned_addr learned my addr 172.21.15.55:0/3984173790 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff532152640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2ba4a7f0 0x562e2b99f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff52bfff640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2b9c00e0 0x562e2ba46dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 -- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2ba4a7f0 msgr2=0x562e2b99f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2ba4a7f0 0x562e2b99f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 -- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2b9c00e0 msgr2=0x562e2ba46dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x562e2b9c00e0 0x562e2ba46dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 -- 172.21.15.55:0/3984173790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e2b975e30 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff532152640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x562e2ba4a7f0 0x562e2b99f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff531951640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba41b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff524025c00 tx=0x7ff524002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff52affd640 1 -- 172.21.15.55:0/3984173790 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524070070 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff52affd640 1 -- 172.21.15.55:0/3984173790 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5240606e0 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e2ba46010 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff52affd640 1 -- 172.21.15.55:0/3984173790 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524065040 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.733+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e2ba465d0 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.735+0000 7ff52affd640 1 -- 172.21.15.55:0/3984173790 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff524073070 con 0x562e2b9a5520 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.735+0000 7ff52affd640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff514074cb0 0x7ff514077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.735+0000 7ff52bfff640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff514074cb0 0x7ff514077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.735+0000 7ff52affd640 1 -- 172.21.15.55:0/3984173790 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff5240db080 con 0x562e2b9a5520 2024-05-10T03:54:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.736+0000 7ff534923f40 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x562e2b9a1520 0x562e2ba42e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.736+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 --> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562e2ba4e510 con 0x562e2b9a1520 2024-05-10T03:54:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.736+0000 7ff52bfff640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff514074cb0 0x7ff514077170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x562e2ba4bce0 tx=0x7ff51c00d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.736+0000 7ff532152640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x562e2b9a1520 0x562e2ba42e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.736+0000 7ff532152640 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x562e2b9a1520 0x562e2ba42e20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff532152640 1 -- 172.21.15.55:0/3984173790 <== osd.6 v2:172.21.15.64:6824/630497291 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7ff52c0028a0 con 0x562e2b9a1520 2024-05-10T03:54:27.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x562e2b9a1520 msgr2=0x562e2ba42e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x562e2b9a1520 0x562e2ba42e20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff514074cb0 msgr2=0x7ff514077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7ff514074cb0 0x7ff514077170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x562e2ba4bce0 tx=0x7ff51c00d040 comp rx=0 tx=0).stop 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 msgr2=0x562e2ba41b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 --2- 172.21.15.55:0/3984173790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562e2b9a5520 0x562e2ba41b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff524025c00 tx=0x7ff524002fb0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff532152640 1 -- 172.21.15.55:0/3984173790 reap_dead start 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 shutdown_connections 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 >> 172.21.15.55:0/3984173790 conn(0x562e2b9a2bd0 msgr2=0x562e2b99e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 shutdown_connections 2024-05-10T03:54:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.737+0000 7ff534923f40 1 -- 172.21.15.55:0/3984173790 wait complete. 2024-05-10T03:54:27.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:27.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.846+0000 7fc1a6967640 1 Processor -- start 2024-05-10T03:54:27.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.846+0000 7fc1a6967640 1 -- start start 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.846+0000 7fc1a6967640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1a015f3d0 0x7fc1a00d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.846+0000 7fc1a6967640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d2980 0x7fc1a00d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc1a6967640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a0160a10 con 0x7fc1a00d3360 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc1a6967640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a0160450 con 0x7fc1a015f3d0 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc1a6967640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a0160730 con 0x7fc1a00d2980 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc19ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1a015f3d0 0x7fc1a00d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc1a4f04640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1a00d3360 0x7fc1a00b4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41504/0 (socket says 172.21.15.55:41504) 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc1a4f04640 1 -- 172.21.15.55:0/3169664291 learned_addr learned my addr 172.21.15.55:0/3169664291 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc19ffff640 1 -- 172.21.15.55:0/3169664291 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d2980 msgr2=0x7fc1a00d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc197fff640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d2980 0x7fc1a00d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc19ffff640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d2980 0x7fc1a00d38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc19f7fe640 1 -- 172.21.15.55:0/3169664291 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499746554 0 0) 0x7fc1a0160a10 con 0x7fc1a00d3360 2024-05-10T03:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc19ffff640 1 -- 172.21.15.55:0/3169664291 >> v1:172.21.15.55:6789/0 conn(0x7fc1a00d3360 legacy=0x7fc1a00b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc19ffff640 1 -- 172.21.15.55:0/3169664291 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a00d1c40 con 0x7fc1a015f3d0 2024-05-10T03:54:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.847+0000 7fc197fff640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d2980 0x7fc1a00d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.848+0000 7fc19ffff640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00d2440 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc1900097a0 tx=0x7fc19002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cba49310151e5f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.848+0000 7fc19f7fe640 1 -- 172.21.15.55:0/3169664291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190037070 con 0x7fc1a015f3d0 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.848+0000 7fc19f7fe640 1 -- 172.21.15.55:0/3169664291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19002ae50 con 0x7fc1a015f3d0 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.848+0000 7fc19f7fe640 1 -- 172.21.15.55:0/3169664291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190032660 con 0x7fc1a015f3d0 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.848+0000 7fc1a6967640 1 -- 172.21.15.55:0/3169664291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a015f3d0 msgr2=0x7fc1a00d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.848+0000 7fc1a6967640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00d2440 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc1900097a0 tx=0x7fc19002a100 comp rx=0 tx=0).stop 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.849+0000 7fc1a6967640 1 -- 172.21.15.55:0/3169664291 shutdown_connections 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.849+0000 7fc1a6967640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d2980 0x7fc1a00d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.849+0000 7fc1a6967640 1 --2- 172.21.15.55:0/3169664291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00d2440 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.849+0000 7fc1a6967640 1 -- 172.21.15.55:0/3169664291 >> 172.21.15.55:0/3169664291 conn(0x7fc1a008ed00 msgr2=0x7fc1a009e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.849+0000 7fc1a6967640 1 -- 172.21.15.55:0/3169664291 shutdown_connections 2024-05-10T03:54:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.849+0000 7fc1a6967640 1 -- 172.21.15.55:0/3169664291 wait complete. 2024-05-10T03:54:27.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.850+0000 7fc1a6967640 1 Processor -- start 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.850+0000 7fc1a6967640 1 -- start start 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d3360 0x7fc1a00b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 0x7fc1a0161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a00b57f0 con 0x7fc1a01f53c0 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a00b5670 con 0x7fc1a015f3d0 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a00ccf70 con 0x7fc1a00d3360 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 0x7fc1a0161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 0x7fc1a0161dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34326/0 (socket says 172.21.15.55:34326) 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 -- 172.21.15.55:0/2829341126 learned_addr learned my addr 172.21.15.55:0/2829341126 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc19ffff640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d3360 0x7fc1a00b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc197fff640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 -- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d3360 msgr2=0x7fc1a00b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d3360 0x7fc1a00b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 -- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1a015f3d0 msgr2=0x7fc1a00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 -- 172.21.15.55:0/2829341126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a00b24f0 con 0x7fc1a01f53c0 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc197fff640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a4f04640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 0x7fc1a0161dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc19800c6e0 tx=0x7fc19800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198018070 con 0x7fc1a01f53c0 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a00b27d0 con 0x7fc1a01f53c0 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc198004d60 con 0x7fc1a01f53c0 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19800a880 con 0x7fc1a01f53c0 2024-05-10T03:54:27.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.851+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a00cd210 con 0x7fc1a01f53c0 2024-05-10T03:54:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.853+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a00a3290 con 0x7fc1a01f53c0 2024-05-10T03:54:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.853+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc19801b070 con 0x7fc1a01f53c0 2024-05-10T03:54:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.854+0000 7fc19d7fa640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc1800762d0 0x7fc180078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.854+0000 7fc19ffff640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc1800762d0 0x7fc180078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.854+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc198096ab0 con 0x7fc1a01f53c0 2024-05-10T03:54:27.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.854+0000 7fc19ffff640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc1800762d0 0x7fc180078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc190034000 tx=0x7fc19002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:27.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:27.858+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc1980604a0 con 0x7fc1a01f53c0 2024-05-10T03:54:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.087+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1a00b67f0 con 0x7fc1a01f53c0 2024-05-10T03:54:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.088+0000 7fc19d7fa640 1 -- 172.21.15.55:0/2829341126 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5175 (secure 0 0 0) 0x7fc19805fda0 con 0x7fc1a01f53c0 2024-05-10T03:54:28.093 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:28.093 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:22.105637+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4800":{"gid":4800,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6836/1112724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1112724499},{"type":"v1","addr":"172.21.15.55:6836","nonce":1112724499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4800,"qdb_cluster":[4800]},"id":2}]} 2024-05-10T03:54:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-05-10T03:54:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc1800762d0 msgr2=0x7fc180078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc1800762d0 0x7fc180078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc190034000 tx=0x7fc19002e000 comp rx=0 tx=0).stop 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 msgr2=0x7fc1a0161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 0x7fc1a0161dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc19800c6e0 tx=0x7fc19800cba0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 shutdown_connections 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc1800762d0 0x7fc180078790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1a01f53c0 0x7fc1a0161dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1a015f3d0 0x7fc1a00b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 --2- 172.21.15.55:0/2829341126 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc1a00d3360 0x7fc1a00b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 >> 172.21.15.55:0/2829341126 conn(0x7fc1a008ed00 msgr2=0x7fc1a015e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 shutdown_connections 2024-05-10T03:54:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.090+0000 7fc1a6967640 1 -- 172.21.15.55:0/2829341126 wait complete. 2024-05-10T03:54:28.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-10T03:54:28.237 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-05-10T03:54:28.237 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T03:54:28.237 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-05-10T03:54:28.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.279+0000 7fd2ab5fef40 1 Processor -- start 2024-05-10T03:54:28.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.279+0000 7fd2ab5fef40 1 -- start start 2024-05-10T03:54:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2ab5fef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b37720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2ab5fef40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 0x558ed8b2b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2ab5fef40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 0x558ed8b31cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2ab5fef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x558ed8aa5b60 con 0x7fd2940022f0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2ab5fef40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558ed8a04f50 con 0x558ed8aa48e0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2ab5fef40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x558ed8aa5230 con 0x558ed8b2b9a0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b37720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b37720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34350/0 (socket says 172.21.15.55:34350) 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 -- 172.21.15.55:0/487495997 learned_addr learned my addr 172.21.15.55:0/487495997 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 -- 172.21.15.55:0/487495997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 msgr2=0x558ed8b31cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 0x558ed8b31cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 -- 172.21.15.55:0/487495997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 msgr2=0x558ed8b2b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 0x558ed8b2b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 -- 172.21.15.55:0/487495997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed8a8ce50 con 0x7fd2940022f0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd2a90f8640 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b37720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd29c025e40 tx=0x7fd29c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb7a3d1afec4e70 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd29b7fe640 1 -- 172.21.15.55:0/487495997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c005250 con 0x7fd2940022f0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd29b7fe640 1 -- 172.21.15.55:0/487495997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c065070 con 0x7fd2940022f0 2024-05-10T03:54:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.280+0000 7fd29b7fe640 1 -- 172.21.15.55:0/487495997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c04d910 con 0x7fd2940022f0 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/487495997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 msgr2=0x558ed8b37720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b37720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd29c025e40 tx=0x7fd29c04f000 comp rx=0 tx=0).stop 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/487495997 shutdown_connections 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 0x558ed8b31cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 0x558ed8b2b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/487495997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b37720 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/487495997 >> 172.21.15.55:0/487495997 conn(0x558ed8a89bd0 msgr2=0x558ed8aa5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/487495997 shutdown_connections 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/487495997 wait complete. 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 Processor -- start 2024-05-10T03:54:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.281+0000 7fd2ab5fef40 1 -- start start 2024-05-10T03:54:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2ab5fef40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 0x558ed8b231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2ab5fef40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 0x558ed8aa2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2ab5fef40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2ab5fef40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x558ed8b33170 con 0x7fd2940022f0 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2ab5fef40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x558ed8b2c2b0 con 0x558ed8aa48e0 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2ab5fef40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x558ed8aa67a0 con 0x558ed8b2b9a0 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2a98f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2a98f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34360/0 (socket says 172.21.15.55:34360) 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2a98f9640 1 -- 172.21.15.55:0/223225216 learned_addr learned my addr 172.21.15.55:0/223225216 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2a88f7640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 0x558ed8aa2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.282+0000 7fd2a90f8640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 0x558ed8b231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2a98f9640 1 -- 172.21.15.55:0/223225216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 msgr2=0x558ed8aa2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2a98f9640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x558ed8b2b9a0 0x558ed8aa2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2a98f9640 1 -- 172.21.15.55:0/223225216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 msgr2=0x558ed8b231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2a98f9640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x558ed8aa48e0 0x558ed8b231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2a98f9640 1 -- 172.21.15.55:0/223225216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed8b23840 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2a98f9640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b228c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x558ed8b38720 tx=0x7fd2a4008670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd29a7fc640 1 -- 172.21.15.55:0/223225216 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4015670 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd29a7fc640 1 -- 172.21.15.55:0/223225216 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a401a070 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ed8b23b20 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd29a7fc640 1 -- 172.21.15.55:0/223225216 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4015a50 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.283+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed8b257d0 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd29a7fc640 1 -- 172.21.15.55:0/223225216 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd2a4015bf0 con 0x7fd2940022f0 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd29a7fc640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd28c074cb0 0x7fd28c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd29a7fc640 1 -- 172.21.15.55:0/223225216 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a40964d0 con 0x7fd2940022f0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd2a90f8640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd28c074cb0 0x7fd28c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x558ed8b277a0 0x558ed8b27bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558ed8b30d40 con 0x558ed8b277a0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.285+0000 7fd2a88f7640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x558ed8b277a0 0x558ed8b27bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2a90f8640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd28c074cb0 0x7fd28c077170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd29c059040 tx=0x7fd29c051000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2a88f7640 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x558ed8b277a0 0x558ed8b27bb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2a88f7640 1 -- 172.21.15.55:0/223225216 <== osd.3 v2:172.21.15.55:6808/600411321 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=19b] v0'0 uv10 ondisk = 0) ==== 164+0+19 (crc 0 0 0) 0x7fd2a0009040 con 0x558ed8b277a0 2024-05-10T03:54:28.292 INFO:teuthology.orchestra.run.smithi055.stdout:alpha_head 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x558ed8b277a0 msgr2=0x558ed8b27bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x558ed8b277a0 0x558ed8b27bb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd28c074cb0 msgr2=0x7fd28c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd28c074cb0 0x7fd28c077170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd29c059040 tx=0x7fd29c051000 comp rx=0 tx=0).stop 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 msgr2=0x558ed8b228c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 --2- 172.21.15.55:0/223225216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2940022f0 0x558ed8b228c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x558ed8b38720 tx=0x7fd2a4008670 comp rx=0 tx=0).stop 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2a98f9640 1 -- 172.21.15.55:0/223225216 reap_dead start 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 shutdown_connections 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 >> 172.21.15.55:0/223225216 conn(0x558ed8a89bd0 msgr2=0x558ed8aa5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 shutdown_connections 2024-05-10T03:54:28.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.286+0000 7fd2ab5fef40 1 -- 172.21.15.55:0/223225216 wait complete. 2024-05-10T03:54:28.295 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-05-10T03:54:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.335+0000 7fc28e6f0f40 1 Processor -- start 2024-05-10T03:54:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.335+0000 7fc28e6f0f40 1 -- start start 2024-05-10T03:54:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28e6f0f40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c24b77a0 0x55a3c24c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28e6f0f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24c9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28e6f0f40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c2443630 0x55a3c24ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28e6f0f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55a3c23a2f50 con 0x55a3c24ce7c0 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28e6f0f40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a3c23a6f90 con 0x55a3c2443630 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28e6f0f40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55a3c2429ef0 con 0x55a3c24b77a0 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34380/0 (socket says 172.21.15.55:34380) 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 -- 172.21.15.55:0/3753187310 learned_addr learned my addr 172.21.15.55:0/3753187310 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28c1ea640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c24b77a0 0x55a3c24c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28c9eb640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c2443630 0x55a3c24ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 -- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c24b77a0 msgr2=0x55a3c24c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c24b77a0 0x55a3c24c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 -- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c2443630 msgr2=0x55a3c24ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c2443630 0x55a3c24ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 -- 172.21.15.55:0/3753187310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c24ceda0 con 0x55a3c24ce7c0 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28c1ea640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c24b77a0 0x55a3c24c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28c9eb640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c2443630 0x55a3c24ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28b9e9640 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24c9210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc280002fb0 tx=0x7fc28000e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd11c4bb5ee25b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.336+0000 7fc28a9e7640 1 -- 172.21.15.55:0/3753187310 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280001b00 con 0x55a3c24ce7c0 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28a9e7640 1 -- 172.21.15.55:0/3753187310 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc280001ca0 con 0x55a3c24ce7c0 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28a9e7640 1 -- 172.21.15.55:0/3753187310 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280002250 con 0x55a3c24ce7c0 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/3753187310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 msgr2=0x55a3c24c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24c9210 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc280002fb0 tx=0x7fc28000e760 comp rx=0 tx=0).stop 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/3753187310 shutdown_connections 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c2443630 0x55a3c24ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24c9210 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/3753187310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c24b77a0 0x55a3c24c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/3753187310 >> 172.21.15.55:0/3753187310 conn(0x55a3c2445d70 msgr2=0x55a3c2442f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/3753187310 shutdown_connections 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.337+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/3753187310 wait complete. 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 Processor -- start 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 -- start start 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c2443630 0x55a3c242a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c24b77a0 0x55a3c24b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55a3c24cbc80 con 0x55a3c24ce7c0 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55a3c24cb9a0 con 0x55a3c24b77a0 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28e6f0f40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55a3c24cbf60 con 0x55a3c2443630 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.338+0000 7fc28c9eb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34384/0 (socket says 172.21.15.55:34384) 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 -- 172.21.15.55:0/2832963679 learned_addr learned my addr 172.21.15.55:0/2832963679 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c1ea640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c2443630 0x55a3c242a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28b9e9640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c24b77a0 0x55a3c24b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 -- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c2443630 msgr2=0x55a3c242a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c2443630 0x55a3c242a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 -- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c24b77a0 msgr2=0x55a3c24b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55a3c24b77a0 0x55a3c24b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 -- 172.21.15.55:0/2832963679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c24b6380 con 0x55a3c24ce7c0 2024-05-10T03:54:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c1ea640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55a3c2443630 0x55a3c242a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28c9eb640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24d0d20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc284026080 tx=0x7fc284001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc2899e5640 1 -- 172.21.15.55:0/2832963679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2840069c0 con 0x55a3c24ce7c0 2024-05-10T03:54:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc2899e5640 1 -- 172.21.15.55:0/2832963679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc284001870 con 0x55a3c24ce7c0 2024-05-10T03:54:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3c24cdf80 con 0x55a3c24ce7c0 2024-05-10T03:54:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc2899e5640 1 -- 172.21.15.55:0/2832963679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28404db20 con 0x55a3c24ce7c0 2024-05-10T03:54:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.339+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c24b6620 con 0x55a3c24ce7c0 2024-05-10T03:54:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.341+0000 7fc2899e5640 1 -- 172.21.15.55:0/2832963679 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc28404dcc0 con 0x55a3c24ce7c0 2024-05-10T03:54:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.341+0000 7fc2899e5640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc278074cb0 0x7fc278077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.341+0000 7fc2899e5640 1 -- 172.21.15.55:0/2832963679 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc2840d9150 con 0x55a3c24ce7c0 2024-05-10T03:54:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.341+0000 7fc28c1ea640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc278074cb0 0x7fc278077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.341+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x55a3c24d1260 0x55a3c2565850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.341+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 --> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a3c24d2070 con 0x55a3c24d1260 2024-05-10T03:54:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.342+0000 7fc28c1ea640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc278074cb0 0x7fc278077170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005400 tx=0x7fc27c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.342+0000 7fc28b9e9640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x55a3c24d1260 0x55a3c2565850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.342+0000 7fc28b9e9640 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x55a3c24d1260 0x55a3c2565850 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28b9e9640 1 -- 172.21.15.55:0/2832963679 <== osd.6 v2:172.21.15.64:6824/630497291 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=19b] v0'0 uv6 ondisk = 0) ==== 154+0+19 (crc 0 0 0) 0x7fc280002050 con 0x55a3c24d1260 2024-05-10T03:54:28.349 INFO:teuthology.orchestra.run.smithi055.stdout:mydir_head 2024-05-10T03:54:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x55a3c24d1260 msgr2=0x55a3c2565850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x55a3c24d1260 0x55a3c2565850 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc278074cb0 msgr2=0x7fc278077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fc278074cb0 0x7fc278077170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005400 tx=0x7fc27c00c040 comp rx=0 tx=0).stop 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 msgr2=0x55a3c24d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 --2- 172.21.15.55:0/2832963679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a3c24ce7c0 0x55a3c24d0d20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc284026080 tx=0x7fc284001de0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28c9eb640 1 -- 172.21.15.55:0/2832963679 reap_dead start 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 shutdown_connections 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 >> 172.21.15.55:0/2832963679 conn(0x55a3c2445d70 msgr2=0x55a3c23fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 shutdown_connections 2024-05-10T03:54:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.343+0000 7fc28e6f0f40 1 -- 172.21.15.55:0/2832963679 wait complete. 2024-05-10T03:54:28.351 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-05-10T03:54:28.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 Processor -- start 2024-05-10T03:54:28.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 -- start start 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae42640 0x56254ae57370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254ae578b0 0x56254ae581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 0x56254ae58710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x56254adbaf50 con 0x56254aee9e00 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56254adbef90 con 0x56254ae578b0 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.393+0000 7f4d430edf40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x56254ae5bb60 con 0x56254ae42640 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 0x56254ae58710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 0x56254ae58710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34396/0 (socket says 172.21.15.55:34396) 2024-05-10T03:54:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 -- 172.21.15.55:0/3202039995 learned_addr learned my addr 172.21.15.55:0/3202039995 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d403e6640 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254ae578b0 0x56254ae581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 -- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae42640 msgr2=0x56254ae57370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d40be7640 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae42640 0x56254ae57370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae42640 0x56254ae57370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 -- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254ae578b0 msgr2=0x56254ae581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254ae578b0 0x56254ae581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 -- 172.21.15.55:0/3202039995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56254ae3d6b0 con 0x56254aee9e00 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d413e8640 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 0x56254ae58710 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4d380099b0 tx=0x7f4d3804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd9a00ebdd2c144 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d3f3e4640 1 -- 172.21.15.55:0/3202039995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38009580 con 0x56254aee9e00 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d3f3e4640 1 -- 172.21.15.55:0/3202039995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d38065070 con 0x56254aee9e00 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.394+0000 7f4d3f3e4640 1 -- 172.21.15.55:0/3202039995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38005d00 con 0x56254aee9e00 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 -- 172.21.15.55:0/3202039995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 msgr2=0x56254ae58710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 0x56254ae58710 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4d380099b0 tx=0x7f4d3804f000 comp rx=0 tx=0).stop 2024-05-10T03:54:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 -- 172.21.15.55:0/3202039995 shutdown_connections 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254aee9e00 0x56254ae58710 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254ae578b0 0x56254ae581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 --2- 172.21.15.55:0/3202039995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae42640 0x56254ae57370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 -- 172.21.15.55:0/3202039995 >> 172.21.15.55:0/3202039995 conn(0x56254ae3fbd0 msgr2=0x56254ae5a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 -- 172.21.15.55:0/3202039995 shutdown_connections 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 -- 172.21.15.55:0/3202039995 wait complete. 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 Processor -- start 2024-05-10T03:54:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.395+0000 7f4d430edf40 1 -- start start 2024-05-10T03:54:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d430edf40 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254ae42640 0x56254aeda8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d430edf40 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae578b0 0x56254aedeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d430edf40 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254aee9e00 0x56254aedf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d430edf40 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x56254aee91c0 con 0x56254ae42640 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d430edf40 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x56254ae5ac10 con 0x56254aee9e00 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d430edf40 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x56254ae5a970 con 0x56254ae578b0 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d40be7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254ae42640 0x56254aeda8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d40be7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254ae42640 0x56254aeda8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34402/0 (socket says 172.21.15.55:34402) 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d40be7640 1 -- 172.21.15.55:0/1127177829 learned_addr learned my addr 172.21.15.55:0/1127177829 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d403e6640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae578b0 0x56254aedeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d413e8640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254aee9e00 0x56254aedf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d40be7640 1 -- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae578b0 msgr2=0x56254aedeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.396+0000 7f4d40be7640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x56254ae578b0 0x56254aedeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d40be7640 1 -- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254aee9e00 msgr2=0x56254aedf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d40be7640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x56254aee9e00 0x56254aedf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d40be7640 1 -- 172.21.15.55:0/1127177829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56254aee55a0 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d40be7640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254ae42640 0x56254aeda8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000e5c0 tx=0x7f4d3000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d3e3e2640 1 -- 172.21.15.55:0/1127177829 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30006020 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d3e3e2640 1 -- 172.21.15.55:0/1127177829 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d300061c0 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56254ae53770 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d3e3e2640 1 -- 172.21.15.55:0/1127177829 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000c660 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.397+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56254ae59320 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.399+0000 7f4d3e3e2640 1 -- 172.21.15.55:0/1127177829 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d30019020 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.399+0000 7f4d3e3e2640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d20074ce0 0x7f4d200771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.399+0000 7f4d403e6640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d20074ce0 0x7f4d200771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.399+0000 7f4d3e3e2640 1 -- 172.21.15.55:0/1127177829 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f4d30095a10 con 0x56254ae42640 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.399+0000 7f4d430edf40 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x56254aee6c70 0x56254ae586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.399+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 --> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56254ae57370 con 0x56254aee6c70 2024-05-10T03:54:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d403e6640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d20074ce0 0x7f4d200771a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4d28001240 tx=0x7f4d28001d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d413e8640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x56254aee6c70 0x56254ae586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d413e8640 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x56254aee6c70 0x56254ae586e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d413e8640 1 -- 172.21.15.55:0/1127177829 <== osd.5 v2:172.21.15.64:6808/3692026818 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (92) out=92b] v0'0 uv6 ondisk = 0) ==== 164+0+92 (crc 0 0 0) 0x7f4d3805b040 con 0x56254aee6c70 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x56254aee6c70 msgr2=0x56254ae586e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x56254aee6c70 0x56254ae586e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d20074ce0 msgr2=0x7f4d200771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f4d20074ce0 0x7f4d200771a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4d28001240 tx=0x7f4d28001d90 comp rx=0 tx=0).stop 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254ae42640 msgr2=0x56254aeda8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 --2- 172.21.15.55:0/1127177829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56254ae42640 0x56254aeda8e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000e5c0 tx=0x7f4d3000ea80 comp rx=0 tx=0).stop 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d413e8640 1 -- 172.21.15.55:0/1127177829 reap_dead start 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 shutdown_connections 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 >> 172.21.15.55:0/1127177829 conn(0x56254ae3fbd0 msgr2=0x56254ae3ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.400+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 shutdown_connections 2024-05-10T03:54:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.401+0000 7f4d430edf40 1 -- 172.21.15.55:0/1127177829 wait complete. 2024-05-10T03:54:28.408 INFO:teuthology.orchestra.run.smithi055.stdout:Valphamydir 2024-05-10T03:54:28.408 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "alpha", 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 6 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-10T03:54:28.509 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "mydir", 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 8 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 5, 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:28.510 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:28.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T03:54:28.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.637+0000 7f0f3bb90640 1 Processor -- start 2024-05-10T03:54:28.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.637+0000 7f0f3bb90640 1 -- start start 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3bb90640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f3409c170 0x7f0f340d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3bb90640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f340b5660 0x7f0f340d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3bb90640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f340cd7d0 con 0x7f0f340b44c0 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3bb90640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f0f340b48a0 con 0x7f0f340b5660 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3bb90640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0f340cdab0 con 0x7f0f3409c170 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3a12d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f340b5660 0x7f0f340d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3992c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0f340b44c0 0x7f0f3409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41550/0 (socket says 172.21.15.55:41550) 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3992c640 1 -- 172.21.15.55:0/2601947646 learned_addr learned my addr 172.21.15.55:0/2601947646 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3912b640 1 --2- 172.21.15.55:0/2601947646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f3409c170 0x7f0f340d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3a12d640 1 -- 172.21.15.55:0/2601947646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f3409c170 msgr2=0x7f0f340d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3a12d640 1 --2- 172.21.15.55:0/2601947646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f3409c170 0x7f0f340d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3a12d640 1 -- 172.21.15.55:0/2601947646 >> v1:172.21.15.55:6789/0 conn(0x7f0f340b44c0 legacy=0x7f0f3409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3a12d640 1 -- 172.21.15.55:0/2601947646 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f340cdd90 con 0x7f0f340b5660 2024-05-10T03:54:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.638+0000 7f0f3892a640 1 -- 172.21.15.55:0/2601947646 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243027041 0 0) 0x7f0f340cd7d0 con 0x7f0f340b44c0 2024-05-10T03:54:28.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.639+0000 7f0f3a12d640 1 --2- 172.21.15.55:0/2601947646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340d16b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009d90 tx=0x7f0f2c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eed23d9c9e75994 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.639+0000 7f0f3892a640 1 -- 172.21.15.55:0/2601947646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c031600 con 0x7f0f340b5660 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.639+0000 7f0f3892a640 1 -- 172.21.15.55:0/2601947646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c0317a0 con 0x7f0f340b5660 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.639+0000 7f0f3892a640 1 -- 172.21.15.55:0/2601947646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c031b70 con 0x7f0f340b5660 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.639+0000 7f0f3bb90640 1 -- 172.21.15.55:0/2601947646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 msgr2=0x7f0f340d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.639+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/2601947646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340d16b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009d90 tx=0x7f0f2c02a5d0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.640+0000 7f0f3bb90640 1 -- 172.21.15.55:0/2601947646 shutdown_connections 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.640+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/2601947646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340d16b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.640+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/2601947646 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f3409c170 0x7f0f340d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.640+0000 7f0f3bb90640 1 -- 172.21.15.55:0/2601947646 >> 172.21.15.55:0/2601947646 conn(0x7f0f340b4b40 msgr2=0x7f0f340b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.640+0000 7f0f3bb90640 1 -- 172.21.15.55:0/2601947646 shutdown_connections 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.640+0000 7f0f3bb90640 1 -- 172.21.15.55:0/2601947646 wait complete. 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.641+0000 7f0f3bb90640 1 Processor -- start 2024-05-10T03:54:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.641+0000 7f0f3bb90640 1 -- start start 2024-05-10T03:54:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.641+0000 7f0f3bb90640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f3409c170 0x7f0f341586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.641+0000 7f0f3bb90640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f340b44c0 0x7f0f341f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.641+0000 7f0f3bb90640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.641+0000 7f0f3bb90640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3406e310 con 0x7f0f340b5660 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3bb90640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3406e6b0 con 0x7f0f3409c170 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3bb90640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3406e490 con 0x7f0f340b44c0 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34424/0 (socket says 172.21.15.55:34424) 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 -- 172.21.15.55:0/3891162528 learned_addr learned my addr 172.21.15.55:0/3891162528 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3912b640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f340b44c0 0x7f0f341f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 -- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f340b44c0 msgr2=0x7f0f341f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3992c640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f3409c170 0x7f0f341586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f340b44c0 0x7f0f341f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 -- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f3409c170 msgr2=0x7f0f341586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f3409c170 0x7f0f341586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 -- 172.21.15.55:0/3891162528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f341f6280 con 0x7f0f340b5660 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3912b640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f340b44c0 0x7f0f341f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3992c640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f3409c170 0x7f0f341586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3a12d640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340c80a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009eb0 tx=0x7f0f2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c040070 con 0x7f0f340b5660 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c030b60 con 0x7f0f340b5660 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f340ca620 con 0x7f0f340b5660 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c009450 con 0x7f0f340b5660 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.642+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f340cabe0 con 0x7f0f340b5660 2024-05-10T03:54:28.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.643+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3406a7e0 con 0x7f0f340b5660 2024-05-10T03:54:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.644+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f2c039040 con 0x7f0f340b5660 2024-05-10T03:54:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.644+0000 7f0f2a7fc640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0f180762d0 0x7f0f18078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.645+0000 7f0f3992c640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0f180762d0 0x7f0f18078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.645+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0f2c0b8d40 con 0x7f0f340b5660 2024-05-10T03:54:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.645+0000 7f0f3992c640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0f180762d0 0x7f0f18078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001220 tx=0x7f0f30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.649+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f2c082690 con 0x7f0f340b5660 2024-05-10T03:54:28.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.879+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0f340d2140 con 0x7f0f340b5660 2024-05-10T03:54:28.883 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-05-10T03:54:28.879+0000 7f4000d9b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T03:54:28.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.881+0000 7f0f2a7fc640 1 -- 172.21.15.55:0/3891162528 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f0f2c081f90 con 0x7f0f340b5660 2024-05-10T03:54:28.885 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.884+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0f180762d0 msgr2=0x7f0f18078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.884+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0f180762d0 0x7f0f18078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001220 tx=0x7f0f30009040 comp rx=0 tx=0).stop 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.884+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 msgr2=0x7f0f340c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.884+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340c80a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009eb0 tx=0x7f0f2c004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 shutdown_connections 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0f180762d0 0x7f0f18078790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f340b5660 0x7f0f340c80a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0f340b44c0 0x7f0f341f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 --2- 172.21.15.55:0/3891162528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f3409c170 0x7f0f341586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 >> 172.21.15.55:0/3891162528 conn(0x7f0f340b4b40 msgr2=0x7f0f340b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 shutdown_connections 2024-05-10T03:54:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.885+0000 7f0f3bb90640 1 -- 172.21.15.55:0/3891162528 wait complete. 2024-05-10T03:54:28.890 INFO:tasks.ceph.mds.a.smithi055.stderr: -4021> 2024-05-10T03:54:24.661+0000 7faa4acd1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T03:54:28.901 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-05-10T03:54:28.921 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-05-10T03:54:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.940+0000 7fd60837b280 1 -- start start 2024-05-10T03:54:28.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.940+0000 7fd60837b280 1 Processor -- start 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd60837b280 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab214acc00 0x55ab22282000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd60837b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 0x55ab22282580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd60837b280 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab214adc00 0x55ab22282b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd60837b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55ab22226600 con 0x55ab214ad800 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd60837b280 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ab22226480 con 0x55ab214adc00 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd60837b280 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55ab22226300 con 0x55ab214acc00 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd606326640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 0x55ab22282580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd606326640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 0x55ab22282580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34458/0 (socket says 172.21.15.55:34458) 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd606326640 1 -- 172.21.15.55:0/200757682 learned_addr learned my addr 172.21.15.55:0/200757682 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd606b27640 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab214acc00 0x55ab22282000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.941+0000 7fd607328640 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab214adc00 0x55ab22282b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd606326640 1 -- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab214acc00 msgr2=0x55ab22282000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd606326640 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab214acc00 0x55ab22282000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd606326640 1 -- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab214adc00 msgr2=0x55ab22282b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd606326640 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab214adc00 0x55ab22282b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd606326640 1 -- 172.21.15.55:0/200757682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab214e2780 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd607328640 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab214adc00 0x55ab22282b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd606326640 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 0x55ab22282580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55ab222c74d0 tx=0x55ab2224e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a179519ac1d658fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd604322640 1 -- 172.21.15.55:0/200757682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ab214d2680 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd604322640 1 -- 172.21.15.55:0/200757682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ab214d8e00 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd604322640 1 -- 172.21.15.55:0/200757682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ab214d2b60 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab214e23c0 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ab214e3680 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd60837b280 4 waiting for MDS map... 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd604322640 1 -- 172.21.15.55:0/200757682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x55ab22386600 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd604322640 1 -- 172.21.15.55:0/200757682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 18) ==== 2885+0+0 (secure 0 0 0) 0x55ab21507180 con 0x55ab214ad800 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd60837b280 4 Got MDS map 18 2024-05-10T03:54:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd60837b280 10 main: JournalTool::main 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.942+0000 7fd60837b280 4 main: JournalTool: connecting to RADOS... 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 Processor -- start 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 -- start start 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55ab22226180 con 0x55ab22371800 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ab2150e480 con 0x55ab22371400 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.943+0000 7fd60837b280 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55ab2150e900 con 0x55ab22371c00 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34474/0 (socket says 172.21.15.55:34474) 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 -- 172.21.15.55:0/981627857 learned_addr learned my addr 172.21.15.55:0/981627857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd607328640 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606326640 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 -- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371c00 msgr2=0x55ab22283b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 -- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 msgr2=0x55ab22283080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 -- 172.21.15.55:0/981627857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab214e34a0 con 0x55ab22371800 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd606b27640 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 0x55ab22283600 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55ab2239c900 tx=0x55ab2239ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb13ffb92fa759be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd60231e640 1 -- 172.21.15.55:0/981627857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ab214d2680 con 0x55ab22371800 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd60231e640 1 -- 172.21.15.55:0/981627857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ab214d8a80 con 0x55ab22371800 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.944+0000 7fd60231e640 1 -- 172.21.15.55:0/981627857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ab214d2b60 con 0x55ab22371800 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 -- 172.21.15.55:0/981627857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 msgr2=0x55ab22283600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 0x55ab22283600 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55ab2239c900 tx=0x55ab2239ec00 comp rx=0 tx=0).stop 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 -- 172.21.15.55:0/981627857 shutdown_connections 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 --2- 172.21.15.55:0/981627857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 -- 172.21.15.55:0/981627857 >> 172.21.15.55:0/981627857 conn(0x55ab22371000 msgr2=0x55ab215ba800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 -- 172.21.15.55:0/981627857 shutdown_connections 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 -- 172.21.15.55:0/981627857 wait complete. 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 Processor -- start 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.945+0000 7fd60837b280 1 -- start start 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd60837b280 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd60837b280 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd60837b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd60837b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55ab22227380 con 0x55ab22371c00 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd60837b280 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55ab22226180 con 0x55ab22371400 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd60837b280 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55ab22227500 con 0x55ab22371800 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34476/0 (socket says 172.21.15.55:34476) 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 -- 172.21.15.55:0/829097038 learned_addr learned my addr 172.21.15.55:0/829097038 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606b27640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd607328640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371800 msgr2=0x55ab22283600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab22371800 0x55ab22283600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 msgr2=0x55ab22283080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab22371400 0x55ab22283080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab214e2780 con 0x55ab22371c00 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.946+0000 7fd606326640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 0x55ab22283b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55ab2239dbc0 tx=0x55ab2224cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.947+0000 7fd600b1b640 1 -- 172.21.15.55:0/829097038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ab214d2820 con 0x55ab22371c00 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.947+0000 7fd600b1b640 1 -- 172.21.15.55:0/829097038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ab214d8c40 con 0x55ab22371c00 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.947+0000 7fd600b1b640 1 -- 172.21.15.55:0/829097038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ab214d2680 con 0x55ab22371c00 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.947+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab214e23c0 con 0x55ab22371c00 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.947+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab214e2000 con 0x55ab22371c00 2024-05-10T03:54:28.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.947+0000 7fd60837b280 4 main: JournalTool: resolving pool 4 2024-05-10T03:54:28.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd600b1b640 1 -- 172.21.15.55:0/829097038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55ab223fcc00 con 0x55ab22371c00 2024-05-10T03:54:28.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd600b1b640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55ab223f5c00 0x55ab22284100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd600b1b640 1 -- 172.21.15.55:0/829097038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x55ab223f6e00 con 0x55ab22371c00 2024-05-10T03:54:28.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd607328640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55ab223f5c00 0x55ab22284100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd60837b280 4 main: JournalTool: creating IoCtx.. 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd60837b280 4 main: Executing for rank 0 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55ab223f5800 0x55ab22284680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.948+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab223f5400 con 0x55ab223f5800 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.949+0000 7fd606b27640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55ab223f5800 0x55ab22284680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.949+0000 7fd607328640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55ab223f5c00 0x55ab22284100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55ab214e5fb0 tx=0x55ab2224e300 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.949+0000 7fd606b27640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55ab223f5800 0x55ab22284680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd606b27640 1 -- 172.21.15.55:0/829097038 <== osd.1 v2:172.21.15.55:6813/141982067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55ab21592000 con 0x55ab223f5800 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 4 Pointer 400.00000000 is readable 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55ab223f4800 0x55ab22284c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab223f4000 con 0x55ab223f4800 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd607328640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55ab223f4800 0x55ab22284c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd607328640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55ab223f4800 0x55ab22284c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd607328640 1 -- 172.21.15.55:0/829097038 <== osd.3 v2:172.21.15.55:6808/600411321 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv18 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55ab21592500 con 0x55ab223f4800 2024-05-10T03:54:28.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 10 Header 0x400000 0x402c08 0x4033f6 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 10 Starting journal scan from offset 0x402c08 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 11272~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab223f4400 con 0x55ab223f4800 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd607328640 1 -- 172.21.15.55:0/829097038 <== osd.3 v2:172.21.15.55:6808/600411321 2 ==== osd_op_reply(3 200.00000001 [read 11272~2030 out=2030b] v0'0 uv15 ondisk = 0) ==== 156+0+2030 (crc 0 0 0) 0x55ab21592500 con 0x55ab223f4800 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.952+0000 7fd60837b280 4 Read 0x7ee bytes from 200.00000001 gap=0 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Parsing data, 0x7ee bytes available 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Attempting decode at 0x402c08 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Consumed 0x37c bytes 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Valid entry at 0x402c08 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Attempting decode at 0x402f84 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Consumed 0x472 bytes 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 10 Valid entry at 0x402f84 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55ab223f5400 0x55ab22285180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 --> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab21850000 con 0x55ab223f5400 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd606b27640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55ab223f5400 0x55ab22285180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.953+0000 7fd606b27640 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55ab223f5400 0x55ab22285180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd606b27640 1 -- 172.21.15.55:0/829097038 <== osd.4 v2:172.21.15.64:6809/945910103 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55ab21592000 con 0x55ab223f5400 2024-05-10T03:54:28.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 4 Reached end of journal objects 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 4 Scanned objects, 0 missing, 1 valid 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 4 Events scanned, 0 gaps 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 4 Found 2 valid events 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 4 Selected 2 events events for processing 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stdout:Events by type: 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stdout: SUBTREEMAP: 1 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stdout: UPDATE: 1 2024-05-10T03:54:28.962 INFO:teuthology.orchestra.run.smithi055.stdout:Errors: 0 2024-05-10T03:54:28.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 4 2 events 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55ab223f5800 msgr2=0x55ab22284680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55ab223f5800 0x55ab22284680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55ab223f4800 msgr2=0x55ab22284c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55ab223f4800 0x55ab22284c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55ab223f5400 msgr2=0x55ab22285180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55ab223f5400 0x55ab22285180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd606b27640 1 -- 172.21.15.55:0/829097038 reap_dead start 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55ab223f5c00 msgr2=0x55ab22284100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55ab223f5c00 0x55ab22284100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55ab214e5fb0 tx=0x55ab2224e300 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 msgr2=0x55ab22283b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 0x55ab22283b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55ab2239dbc0 tx=0x55ab2224cc00 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 shutdown_connections 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55ab223f5c00 0x55ab22284100 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/829097038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab22371c00 0x55ab22283b80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 >> 172.21.15.55:0/829097038 conn(0x55ab22371000 msgr2=0x55ab215ba800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 shutdown_connections 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/829097038 wait complete. 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 msgr2=0x55ab22282580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 0x55ab22282580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55ab222c74d0 tx=0x55ab2224e120 comp rx=0 tx=0).stop 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 shutdown_connections 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55ab214adc00 0x55ab22282b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ab214ad800 0x55ab22282580 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 --2- 172.21.15.55:0/200757682 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55ab214acc00 0x55ab22282000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 >> 172.21.15.55:0/200757682 conn(0x55ab214ad000 msgr2=0x55ab215bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.954+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 shutdown_connections 2024-05-10T03:54:28.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:28.955+0000 7fd60837b280 1 -- 172.21.15.55:0/200757682 wait complete. 2024-05-10T03:54:28.966 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.065974, result: Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-10T03:54:28.967 DEBUG:tasks.cephfs.test_flush:jos summary_output=Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-10T03:54:28.967 DEBUG:tasks.cephfs.test_flush:jos AssertionError 2024-05-10T03:54:28.967 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-05-10T03:54:29.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.044+0000 7f53f6f7b280 1 -- start start 2024-05-10T03:54:29.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.044+0000 7f53f6f7b280 1 Processor -- start 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4273a6c00 0x55d42817e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 0x55d42817e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d4273a7c00 0x55d42817eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55d428144600 con 0x55d4273a7800 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d428144480 con 0x55d4273a6c00 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55d428144300 con 0x55d4273a7c00 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 0x55d42817e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 0x55d42817e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34480/0 (socket says 172.21.15.55:34480) 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 -- 172.21.15.55:0/2611144878 learned_addr learned my addr 172.21.15.55:0/2611144878 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f5727640 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4273a6c00 0x55d42817e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f5f28640 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d4273a7c00 0x55d42817eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 -- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d4273a7c00 msgr2=0x55d42817eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d4273a7c00 0x55d42817eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 -- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4273a6c00 msgr2=0x55d42817e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4273a6c00 0x55d42817e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.045+0000 7f53f4f26640 1 -- 172.21.15.55:0/2611144878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4273dc780 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f4f26640 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 0x55d42817e580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d4281d58c0 tx=0x55d4281480c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e3ced070b1428f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f2f22640 1 -- 172.21.15.55:0/2611144878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4273cc680 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f2f22640 1 -- 172.21.15.55:0/2611144878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d4273d2700 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4273dd680 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55d4273dc000 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f6f7b280 4 waiting for MDS map... 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f2f22640 1 -- 172.21.15.55:0/2611144878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4273cc9c0 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f2f22640 1 -- 172.21.15.55:0/2611144878 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x55d42828e600 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f2f22640 1 -- 172.21.15.55:0/2611144878 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 18) ==== 2885+0+0 (secure 0 0 0) 0x55d427401180 con 0x55d4273a7800 2024-05-10T03:54:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f6f7b280 4 Got MDS map 18 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f6f7b280 10 main: JournalTool::main 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.046+0000 7f53f6f7b280 4 main: JournalTool: connecting to RADOS... 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 Processor -- start 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 -- start start 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55d428144180 con 0x55d428193800 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d427408480 con 0x55d428193c00 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55d427408900 con 0x55d428193400 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f5727640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f5727640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34484/0 (socket says 172.21.15.55:34484) 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.047+0000 7f53f5727640 1 -- 172.21.15.55:0/1084524125 learned_addr learned my addr 172.21.15.55:0/1084524125 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5727640 1 -- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 msgr2=0x55d42817f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5f28640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f4f26640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5727640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5727640 1 -- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 msgr2=0x55d42817fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5727640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5727640 1 -- 172.21.15.55:0/1084524125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4273dc3c0 con 0x55d428193800 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5f28640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f4f26640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f5727640 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55d4281ba5a0 tx=0x55d428146600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfff448d1ffbf8a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f0f1e640 1 -- 172.21.15.55:0/1084524125 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4273cc680 con 0x55d428193800 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f0f1e640 1 -- 172.21.15.55:0/1084524125 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d4273d2e00 con 0x55d428193800 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f0f1e640 1 -- 172.21.15.55:0/1084524125 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4273cc9c0 con 0x55d428193800 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 -- 172.21.15.55:0/1084524125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 msgr2=0x55d42817f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55d4281ba5a0 tx=0x55d428146600 comp rx=0 tx=0).stop 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 -- 172.21.15.55:0/1084524125 shutdown_connections 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/1084524125 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.048+0000 7f53f6f7b280 1 -- 172.21.15.55:0/1084524125 >> 172.21.15.55:0/1084524125 conn(0x55d428193000 msgr2=0x55d42749e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.049+0000 7f53f6f7b280 1 -- 172.21.15.55:0/1084524125 shutdown_connections 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.049+0000 7f53f6f7b280 1 -- 172.21.15.55:0/1084524125 wait complete. 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.049+0000 7f53f6f7b280 1 Processor -- start 2024-05-10T03:54:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.049+0000 7f53f6f7b280 1 -- start start 2024-05-10T03:54:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55d428145200 con 0x55d428193800 2024-05-10T03:54:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55d428144180 con 0x55d428193c00 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55d428145380 con 0x55d428193400 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34494/0 (socket says 172.21.15.55:34494) 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 -- 172.21.15.55:0/3408599748 learned_addr learned my addr 172.21.15.55:0/3408599748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f4f26640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5f28640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 msgr2=0x55d42817f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 msgr2=0x55d42817fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4273dc780 con 0x55d428193800 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f4f26640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d428193c00 0x55d42817fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5f28640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d428193400 0x55d42817f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f5727640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55d4281ba8d0 tx=0x55d428146ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53ef71b640 1 -- 172.21.15.55:0/3408599748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4273cc680 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53ef71b640 1 -- 172.21.15.55:0/3408599748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d4273d2c40 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53ef71b640 1 -- 172.21.15.55:0/3408599748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55d4273cc9c0 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4273dd680 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4273dc960 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.050+0000 7f53f6f7b280 4 main: JournalTool: resolving pool 4 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53ef71b640 1 -- 172.21.15.55:0/3408599748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x55d4282eec00 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53ef71b640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55d427732000 0x55d428180100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53ef71b640 1 -- 172.21.15.55:0/3408599748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x55d4273a5600 con 0x55d428193800 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53f6f7b280 4 main: JournalTool: creating IoCtx.. 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53f6f7b280 4 main: Executing for rank 0 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55d427732400 0x55d428180680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53f5f28640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55d427732000 0x55d428180100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d427732800 con 0x55d427732400 2024-05-10T03:54:29.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.052+0000 7f53f4f26640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55d427732400 0x55d428180680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f5f28640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55d427732000 0x55d428180100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55d4281d56b0 tx=0x55d428298fc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f4f26640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55d427732400 0x55d428180680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f4f26640 1 -- 172.21.15.55:0/3408599748 <== osd.1 v2:172.21.15.55:6813/141982067 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55d4274b4000 con 0x55d427732400 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f6f7b280 4 Pointer 400.00000000 is readable 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f6f7b280 4 JournalScanner::scan: reading header object '200.00000000' 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55d427732c00 0x55d428180c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d427733000 con 0x55d427732c00 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f5f28640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55d427732c00 0x55d428180c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.053+0000 7f53f5f28640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55d427732c00 0x55d428180c00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f5f28640 1 -- 172.21.15.55:0/3408599748 <== osd.3 v2:172.21.15.55:6808/600411321 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv18 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55d4274b4500 con 0x55d427732c00 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Header 0x400000 0x402c08 0x4033f6 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Starting journal scan from offset 0x402c08 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 11272~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d427733400 con 0x55d427732c00 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f5f28640 1 -- 172.21.15.55:0/3408599748 <== osd.3 v2:172.21.15.55:6808/600411321 2 ==== osd_op_reply(3 200.00000001 [read 11272~2030 out=2030b] v0'0 uv15 ondisk = 0) ==== 156+0+2030 (crc 0 0 0) 0x55d4274b4500 con 0x55d427732c00 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 4 Read 0x7ee bytes from 200.00000001 gap=0 2024-05-10T03:54:29.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Parsing data, 0x7ee bytes available 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Attempting decode at 0x402c08 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Consumed 0x37c bytes 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Valid entry at 0x402c08 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Attempting decode at 0x402f84 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Consumed 0x472 bytes 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 10 Valid entry at 0x402f84 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55d427750000 0x55d428181180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 --> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d427750400 con 0x55d427750000 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.054+0000 7f53f5727640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55d427750000 0x55d428181180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f5727640 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55d427750000 0x55d428181180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f5727640 1 -- 172.21.15.55:0/3408599748 <== osd.4 v2:172.21.15.64:6809/945910103 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55d4274b4f00 con 0x55d427750000 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 4 Reached end of journal objects 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 4 Scanned objects, 0 missing, 1 valid 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 4 Events scanned, 0 gaps 2024-05-10T03:54:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 4 Found 2 valid events 2024-05-10T03:54:29.067 INFO:teuthology.orchestra.run.smithi055.stdout:Events by type: 2024-05-10T03:54:29.067 INFO:teuthology.orchestra.run.smithi055.stdout: SUBTREEMAP: 1 2024-05-10T03:54:29.067 INFO:teuthology.orchestra.run.smithi055.stdout: UPDATE: 1 2024-05-10T03:54:29.067 INFO:teuthology.orchestra.run.smithi055.stdout:Errors: 0 2024-05-10T03:54:29.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 4 Selected 2 events events for processing 2024-05-10T03:54:29.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 4 2 events 2024-05-10T03:54:29.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55d427732400 msgr2=0x55d428180680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x55d427732400 0x55d428180680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55d427732c00 msgr2=0x55d428180c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x55d427732c00 0x55d428180c00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55d427750000 msgr2=0x55d428181180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x55d427750000 0x55d428181180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f5727640 1 -- 172.21.15.55:0/3408599748 reap_dead start 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55d427732000 msgr2=0x55d428180100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55d427732000 0x55d428180100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55d4281d56b0 tx=0x55d428298fc0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 msgr2=0x55d42817f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55d4281ba8d0 tx=0x55d428146ae0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 shutdown_connections 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x55d427732000 0x55d428180100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/3408599748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d428193800 0x55d42817f600 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 >> 172.21.15.55:0/3408599748 conn(0x55d428193000 msgr2=0x55d42749e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 shutdown_connections 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.055+0000 7f53f6f7b280 1 -- 172.21.15.55:0/3408599748 wait complete. 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 msgr2=0x55d42817e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 0x55d42817e580 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d4281d58c0 tx=0x55d4281480c0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 shutdown_connections 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55d4273a7c00 0x55d42817eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d4273a7800 0x55d42817e580 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 --2- 172.21.15.55:0/2611144878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55d4273a6c00 0x55d42817e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 >> 172.21.15.55:0/2611144878 conn(0x55d4273a7000 msgr2=0x55d42749f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 shutdown_connections 2024-05-10T03:54:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.056+0000 7f53f6f7b280 1 -- 172.21.15.55:0/2611144878 wait complete. 2024-05-10T03:54:29.071 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.104404, result: Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-05-10T03:54:29.072 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T03:54:29.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T03:54:29.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T03:54:29.204 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T03:54:29.205 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T03:54:29.205 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:29.205 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:29.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=440 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T03:54:29.221 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T03:54:29.222 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:29.222 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:29.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2620 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T03:54:29.241 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T03:54:29.241 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:29.241 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:29.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=440 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T03:54:29.278 INFO:tasks.cephfs.mount:Terminating background process 2024-05-10T03:54:29.278 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:29.278 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:29.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2620 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T03:54:29.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:29.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.420+0000 7f38902cf640 1 Processor -- start 2024-05-10T03:54:29.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.420+0000 7f38902cf640 1 -- start start 2024-05-10T03:54:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f38902cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3888163080 0x7f3888163460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f38902cf640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3888163cb0 0x7f38880d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f38902cf640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38881639a0 con 0x7f38880cdf70 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f38902cf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f388809ba60 con 0x7f3888163080 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f38902cf640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f388809bcb0 con 0x7f3888163cb0 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3888163080 0x7f3888163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3888163080 0x7f3888163460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34504/0 (socket says 172.21.15.55:34504) 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 -- 172.21.15.55:0/2919832006 learned_addr learned my addr 172.21.15.55:0/2919832006 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 -- 172.21.15.55:0/2919832006 >> v2:172.21.15.64:3300/0 conn(0x7f3888163cb0 msgr2=0x7f38880d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388d86a640 1 --2- 172.21.15.55:0/2919832006 >> v2:172.21.15.64:3300/0 conn(0x7f3888163cb0 0x7f38880d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 --2- 172.21.15.55:0/2919832006 >> v2:172.21.15.64:3300/0 conn(0x7f3888163cb0 0x7f38880d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 -- 172.21.15.55:0/2919832006 >> v1:172.21.15.64:6789/0 conn(0x7f38880cdf70 legacy=0x7f38880ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.421+0000 7f388e06b640 1 -- 172.21.15.55:0/2919832006 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388809bf90 con 0x7f3888163080 2024-05-10T03:54:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.422+0000 7f388e06b640 1 --2- 172.21.15.55:0/2919832006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163080 0x7f3888163460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f38880d2f50 tx=0x7f388402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6707676c923ebba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.422+0000 7f388d069640 1 -- 172.21.15.55:0/2919832006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884037070 con 0x7f3888163080 2024-05-10T03:54:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.422+0000 7f388d069640 1 -- 172.21.15.55:0/2919832006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3884032440 con 0x7f3888163080 2024-05-10T03:54:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.422+0000 7f388d069640 1 -- 172.21.15.55:0/2919832006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884032810 con 0x7f3888163080 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 -- 172.21.15.55:0/2919832006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163080 msgr2=0x7f3888163460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 --2- 172.21.15.55:0/2919832006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163080 0x7f3888163460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f38880d2f50 tx=0x7f388402a270 comp rx=0 tx=0).stop 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 -- 172.21.15.55:0/2919832006 shutdown_connections 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 --2- 172.21.15.55:0/2919832006 >> v2:172.21.15.64:3300/0 conn(0x7f3888163cb0 0x7f38880d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 --2- 172.21.15.55:0/2919832006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163080 0x7f3888163460 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 -- 172.21.15.55:0/2919832006 >> 172.21.15.55:0/2919832006 conn(0x7f38880b4d70 msgr2=0x7f38880b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 -- 172.21.15.55:0/2919832006 shutdown_connections 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.423+0000 7f38902cf640 1 -- 172.21.15.55:0/2919832006 wait complete. 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.424+0000 7f38902cf640 1 Processor -- start 2024-05-10T03:54:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.424+0000 7f38902cf640 1 -- start start 2024-05-10T03:54:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f38902cf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38880cdf70 0x7f38881e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f38902cf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888163080 0x7f38880cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f38902cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 0x7f388814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f38902cf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f388809c830 con 0x7f3888163cb0 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f38902cf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f388809c550 con 0x7f3888163080 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f38902cf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f38880d2250 con 0x7f38880cdf70 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 0x7f388814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 0x7f388814b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34520/0 (socket says 172.21.15.55:34520) 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 -- 172.21.15.55:0/2298936407 learned_addr learned my addr 172.21.15.55:0/2298936407 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388d86a640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888163080 0x7f38880cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e06b640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38880cdf70 0x7f38881e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 -- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38880cdf70 msgr2=0x7f38881e92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38880cdf70 0x7f38881e92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 -- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888163080 msgr2=0x7f38880cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888163080 0x7f38880cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.425+0000 7f388e86c640 1 -- 172.21.15.55:0/2298936407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388814bb90 con 0x7f3888163cb0 2024-05-10T03:54:29.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.426+0000 7f388e86c640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 0x7f388814b650 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f388000c780 tx=0x7f388000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.426+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880017070 con 0x7f3888163cb0 2024-05-10T03:54:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.426+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880003da0 con 0x7f3888163cb0 2024-05-10T03:54:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.426+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800052b0 con 0x7f3888163cb0 2024-05-10T03:54:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.426+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388814be10 con 0x7f3888163cb0 2024-05-10T03:54:29.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.426+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388814c3d0 con 0x7f3888163cb0 2024-05-10T03:54:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.427+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388814b370 con 0x7f3888163cb0 2024-05-10T03:54:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.428+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3880005450 con 0x7f3888163cb0 2024-05-10T03:54:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.428+0000 7f387effd640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f386c0762d0 0x7f386c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.428+0000 7f388e06b640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f386c0762d0 0x7f386c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.428+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f3880096c30 con 0x7f3888163cb0 2024-05-10T03:54:29.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.429+0000 7f388e06b640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f386c0762d0 0x7f386c078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3884034000 tx=0x7f388402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.433+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f388814b370 con 0x7f3888163cb0 2024-05-10T03:54:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.665+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38880a1390 con 0x7f3888163cb0 2024-05-10T03:54:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.665+0000 7f387effd640 1 -- 172.21.15.55:0/2298936407 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4336 (secure 0 0 0) 0x7f388814bb90 con 0x7f3888163cb0 2024-05-10T03:54:29.669 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:29.669 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:28.881667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-10T03:54:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 18 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f386c0762d0 msgr2=0x7f386c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f386c0762d0 0x7f386c078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3884034000 tx=0x7f388402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 msgr2=0x7f388814b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 0x7f388814b650 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f388000c780 tx=0x7f388000cc40 comp rx=0 tx=0).stop 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 shutdown_connections 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f386c0762d0 0x7f386c078790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3888163cb0 0x7f388814b650 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3888163080 0x7f38880cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 --2- 172.21.15.55:0/2298936407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38880cdf70 0x7f38881e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 >> 172.21.15.55:0/2298936407 conn(0x7f38880b4d70 msgr2=0x7f38880cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:29.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 shutdown_connections 2024-05-10T03:54:29.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.667+0000 7f38902cf640 1 -- 172.21.15.55:0/2298936407 wait complete. 2024-05-10T03:54:29.682 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:29.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.784+0000 7f7a91800640 1 Processor -- start 2024-05-10T03:54:29.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.784+0000 7f7a91800640 1 -- start start 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.784+0000 7f7a91800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a8c15f7a0 0x7f7a8c0d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a91800640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7a8c0d2fe0 0x7f7a8c0d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a91800640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8c0d0f90 con 0x7f7a8c15f3c0 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a91800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8c0b4cc0 con 0x7f7a8c15f7a0 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a91800640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8c0d1270 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a8c15f7a0 0x7f7a8c0d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a8c15f7a0 0x7f7a8c0d3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34524/0 (socket says 172.21.15.55:34524) 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 -- 172.21.15.55:0/2802478093 learned_addr learned my addr 172.21.15.55:0/2802478093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8b7fe640 1 --2- 172.21.15.55:0/2802478093 >> v2:172.21.15.64:3300/0 conn(0x7f7a8c0d2fe0 0x7f7a8c0d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 -- 172.21.15.55:0/2802478093 >> v2:172.21.15.64:3300/0 conn(0x7f7a8c0d2fe0 msgr2=0x7f7a8c0d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:29.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 --2- 172.21.15.55:0/2802478093 >> v2:172.21.15.64:3300/0 conn(0x7f7a8c0d2fe0 0x7f7a8c0d3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 -- 172.21.15.55:0/2802478093 >> v1:172.21.15.64:6789/0 conn(0x7f7a8c15f3c0 legacy=0x7f7a8c0d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.785+0000 7f7a8a7fc640 1 -- 172.21.15.55:0/2802478093 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0b4670 con 0x7f7a8c15f7a0 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a8a7fc640 1 --2- 172.21.15.55:0/2802478093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c15f7a0 0x7f7a8c0d3550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c08ea20 tx=0x7f7a8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168a1627ad413856 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a89ffb640 1 -- 172.21.15.55:0/2802478093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80037070 con 0x7f7a8c15f7a0 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a89ffb640 1 -- 172.21.15.55:0/2802478093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a80032440 con 0x7f7a8c15f7a0 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a89ffb640 1 -- 172.21.15.55:0/2802478093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80032810 con 0x7f7a8c15f7a0 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a91800640 1 -- 172.21.15.55:0/2802478093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c15f7a0 msgr2=0x7f7a8c0d3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a91800640 1 --2- 172.21.15.55:0/2802478093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c15f7a0 0x7f7a8c0d3550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c08ea20 tx=0x7f7a8002a270 comp rx=0 tx=0).stop 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.786+0000 7f7a91800640 1 -- 172.21.15.55:0/2802478093 shutdown_connections 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.787+0000 7f7a91800640 1 --2- 172.21.15.55:0/2802478093 >> v2:172.21.15.64:3300/0 conn(0x7f7a8c0d2fe0 0x7f7a8c0d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.787+0000 7f7a91800640 1 --2- 172.21.15.55:0/2802478093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c15f7a0 0x7f7a8c0d3550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.787+0000 7f7a91800640 1 -- 172.21.15.55:0/2802478093 >> 172.21.15.55:0/2802478093 conn(0x7f7a8c0d5120 msgr2=0x7f7a8c0d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:29.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.787+0000 7f7a91800640 1 -- 172.21.15.55:0/2802478093 shutdown_connections 2024-05-10T03:54:29.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.787+0000 7f7a91800640 1 -- 172.21.15.55:0/2802478093 wait complete. 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.788+0000 7f7a91800640 1 Processor -- start 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.788+0000 7f7a91800640 1 -- start start 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 0x7f7a8c162700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a91800640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a8c15f3c0 0x7f7a8c0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a91800640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a8c15f7a0 0x7f7a8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a91800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0b52d0 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a91800640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0b5150 con 0x7f7a8c15f3c0 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a91800640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c0b5450 con 0x7f7a8c15f7a0 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 0x7f7a8c162700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 0x7f7a8c162700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34530/0 (socket says 172.21.15.55:34530) 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 -- 172.21.15.55:0/403859810 learned_addr learned my addr 172.21.15.55:0/403859810 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8a7fc640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a8c15f3c0 0x7f7a8c0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8b7fe640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a8c15f7a0 0x7f7a8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 -- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a8c15f7a0 msgr2=0x7f7a8c06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a8c15f7a0 0x7f7a8c06d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 -- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a8c15f3c0 msgr2=0x7f7a8c0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a8c15f3c0 0x7f7a8c0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.789+0000 7f7a8affd640 1 -- 172.21.15.55:0/403859810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0ceb70 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.790+0000 7f7a8affd640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 0x7f7a8c162700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c450 tx=0x7f7a7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.790+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c017070 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.790+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7c0052d0 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.790+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c15fc40 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.790+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c003830 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.790+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c160200 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.791+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c050740 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.791+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a7c01a070 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.792+0000 7f7a737fe640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7a780762d0 0x7f7a78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.792+0000 7f7a8a7fc640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7a780762d0 0x7f7a78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:29.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.792+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f7a7c0968c0 con 0x7f7a8c0d2fe0 2024-05-10T03:54:29.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.793+0000 7f7a8a7fc640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7a780762d0 0x7f7a78078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a80034000 tx=0x7f7a8002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:29.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:29.797+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a7c05fc00 con 0x7f7a8c0d2fe0 2024-05-10T03:54:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.029+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a8c0b65e0 con 0x7f7a8c0d2fe0 2024-05-10T03:54:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.029+0000 7f7a737fe640 1 -- 172.21.15.55:0/403859810 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5158 (secure 0 0 0) 0x7f7a7c096090 con 0x7f7a8c0d2fe0 2024-05-10T03:54:30.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:30.034 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/401830949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":401830949},{"type":"v1","addr":"172.21.15.55:6836","nonce":401830949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:28.881667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-10T03:54:30.034 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2024-05-10T03:54:30.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7a780762d0 msgr2=0x7f7a78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7a780762d0 0x7f7a78078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a80034000 tx=0x7f7a8002e000 comp rx=0 tx=0).stop 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 msgr2=0x7f7a8c162700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 0x7f7a8c162700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c450 tx=0x7f7a7c00c910 comp rx=0 tx=0).stop 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 shutdown_connections 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a8c15f7a0 0x7f7a8c06d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a8c15f3c0 0x7f7a8c0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f7a780762d0 0x7f7a78078790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 --2- 172.21.15.55:0/403859810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a8c0d2fe0 0x7f7a8c162700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 >> 172.21.15.55:0/403859810 conn(0x7f7a8c0d5120 msgr2=0x7f7a8c0b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 shutdown_connections 2024-05-10T03:54:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.032+0000 7f7a91800640 1 -- 172.21.15.55:0/403859810 wait complete. 2024-05-10T03:54:30.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.147+0000 7fe627446640 1 Processor -- start 2024-05-10T03:54:30.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.147+0000 7fe627446640 1 -- start start 2024-05-10T03:54:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe627446640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe62015d290 0x7fe620074210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe627446640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6200b69e0 0x7fe62015db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe627446640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62015d670 con 0x7fe620073ba0 2024-05-10T03:54:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe627446640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fe6200b3980 con 0x7fe6200b69e0 2024-05-10T03:54:30.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe627446640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fe6200cdb20 con 0x7fe62015d290 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe6259e3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6200b69e0 0x7fe62015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe6249e1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe620073ba0 0x7fe6200b62d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41574/0 (socket says 172.21.15.55:41574) 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe6249e1640 1 -- 172.21.15.55:0/1201041834 learned_addr learned my addr 172.21.15.55:0/1201041834 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.148+0000 7fe6251e2640 1 --2- 172.21.15.55:0/1201041834 >> v2:172.21.15.64:3300/0 conn(0x7fe62015d290 0x7fe620074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe6259e3640 1 -- 172.21.15.55:0/1201041834 >> v2:172.21.15.64:3300/0 conn(0x7fe62015d290 msgr2=0x7fe620074210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe6259e3640 1 --2- 172.21.15.55:0/1201041834 >> v2:172.21.15.64:3300/0 conn(0x7fe62015d290 0x7fe620074210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe6259e3640 1 -- 172.21.15.55:0/1201041834 >> v1:172.21.15.55:6789/0 conn(0x7fe620073ba0 legacy=0x7fe6200b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe6259e3640 1 -- 172.21.15.55:0/1201041834 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6200cde00 con 0x7fe6200b69e0 2024-05-10T03:54:30.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe617fff640 1 -- 172.21.15.55:0/1201041834 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009879406 0 0) 0x7fe62015d670 con 0x7fe620073ba0 2024-05-10T03:54:30.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe6259e3640 1 --2- 172.21.15.55:0/1201041834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6200b69e0 0x7fe62015db00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe6200b71d0 tx=0x7fe61802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1205a84c1b002eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe617fff640 1 -- 172.21.15.55:0/1201041834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618007740 con 0x7fe6200b69e0 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe617fff640 1 -- 172.21.15.55:0/1201041834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6180078e0 con 0x7fe6200b69e0 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.149+0000 7fe617fff640 1 -- 172.21.15.55:0/1201041834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618007cb0 con 0x7fe6200b69e0 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 -- 172.21.15.55:0/1201041834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6200b69e0 msgr2=0x7fe62015db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 --2- 172.21.15.55:0/1201041834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6200b69e0 0x7fe62015db00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe6200b71d0 tx=0x7fe61802a5f0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 -- 172.21.15.55:0/1201041834 shutdown_connections 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 --2- 172.21.15.55:0/1201041834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6200b69e0 0x7fe62015db00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 --2- 172.21.15.55:0/1201041834 >> v2:172.21.15.64:3300/0 conn(0x7fe62015d290 0x7fe620074210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 -- 172.21.15.55:0/1201041834 >> 172.21.15.55:0/1201041834 conn(0x7fe6200b2cc0 msgr2=0x7fe6200b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 -- 172.21.15.55:0/1201041834 shutdown_connections 2024-05-10T03:54:30.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.150+0000 7fe627446640 1 -- 172.21.15.55:0/1201041834 wait complete. 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.151+0000 7fe627446640 1 Processor -- start 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.151+0000 7fe627446640 1 -- start start 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe627446640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe620073ba0 0x7fe62014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe627446640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6200b69e0 0x7fe62015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe627446640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 0x7fe6200b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe627446640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe62015e1c0 con 0x7fe62015d290 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe627446640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe62015e040 con 0x7fe6200b69e0 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe627446640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe62015e340 con 0x7fe620073ba0 2024-05-10T03:54:30.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe6259e3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 0x7fe6200b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe6259e3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 0x7fe6200b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34542/0 (socket says 172.21.15.55:34542) 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe6259e3640 1 -- 172.21.15.55:0/2991939488 learned_addr learned my addr 172.21.15.55:0/2991939488 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe6251e2640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe620073ba0 0x7fe62014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.152+0000 7fe6249e1640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6200b69e0 0x7fe62015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe6259e3640 1 -- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe620073ba0 msgr2=0x7fe62014fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe6259e3640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe620073ba0 0x7fe62014fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe6259e3640 1 -- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6200b69e0 msgr2=0x7fe62015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe6259e3640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6200b69e0 0x7fe62015a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe6259e3640 1 -- 172.21.15.55:0/2991939488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62015b390 con 0x7fe62015d290 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe6259e3640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 0x7fe6200b1b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe61802abe0 tx=0x7fe618004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618040070 con 0x7fe62015d290 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe618031bc0 con 0x7fe62015d290 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6200b4180 con 0x7fe62015d290 2024-05-10T03:54:30.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618009450 con 0x7fe62015d290 2024-05-10T03:54:30.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.153+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6201502e0 con 0x7fe62015d290 2024-05-10T03:54:30.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.154+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62015ca10 con 0x7fe62015d290 2024-05-10T03:54:30.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.155+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe618039040 con 0x7fe62015d290 2024-05-10T03:54:30.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.155+0000 7fe615ffb640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe6040762d0 0x7fe604078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.155+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fe6180b8dc0 con 0x7fe62015d290 2024-05-10T03:54:30.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.155+0000 7fe6251e2640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe6040762d0 0x7fe604078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.156+0000 7fe6251e2640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe6040762d0 0x7fe604078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009aa0 tx=0x7fe61c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.160+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe62015ca10 con 0x7fe62015d290 2024-05-10T03:54:30.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.353+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe62006f450 con 0x7fe62015d290 2024-05-10T03:54:30.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.354+0000 7fe615ffb640 1 -- 172.21.15.55:0/2991939488 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16702 (secure 0 0 0) 0x7fe618082060 con 0x7fe62015d290 2024-05-10T03:54:30.358 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:30.358 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:54:28.881514+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:54:17.121690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T03:54:18.026924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6836/1112724499":"2024-05-11T03:54:28.881488+0000","172.21.15.55:6834/1112724499":"2024-05-11T03:54:28.881488+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe6040762d0 msgr2=0x7fe604078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe6040762d0 0x7fe604078790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009aa0 tx=0x7fe61c009190 comp rx=0 tx=0).stop 2024-05-10T03:54:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 msgr2=0x7fe6200b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 0x7fe6200b1b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe61802abe0 tx=0x7fe618004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 shutdown_connections 2024-05-10T03:54:30.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fe6040762d0 0x7fe604078790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62015d290 0x7fe6200b1b80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe6200b69e0 0x7fe62015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 --2- 172.21.15.55:0/2991939488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe620073ba0 0x7fe62014fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 >> 172.21.15.55:0/2991939488 conn(0x7fe6200b2cc0 msgr2=0x7fe620072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 shutdown_connections 2024-05-10T03:54:30.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.356+0000 7fe627446640 1 -- 172.21.15.55:0/2991939488 wait complete. 2024-05-10T03:54:30.371 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T03:54:30.371 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:30.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.471+0000 7f9f8f332640 1 Processor -- start 2024-05-10T03:54:30.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.471+0000 7f9f8f332640 1 -- start start 2024-05-10T03:54:30.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8f332640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f88162aa0 0x7f9f880d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8f332640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f880d3690 0x7f9f880bac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8f332640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f880d3b90 con 0x7f9f880d1d40 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8f332640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f9f880d5170 con 0x7f9f880d3690 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8f332640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9f880d3e70 con 0x7f9f88162aa0 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8c8cd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f880d3690 0x7f9f880bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8d8cf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f880d1d40 0x7f9f880b8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41588/0 (socket says 172.21.15.55:41588) 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8d8cf640 1 -- 172.21.15.55:0/2980921351 learned_addr learned my addr 172.21.15.55:0/2980921351 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8d0ce640 1 --2- 172.21.15.55:0/2980921351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f88162aa0 0x7f9f880d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8c8cd640 1 -- 172.21.15.55:0/2980921351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f88162aa0 msgr2=0x7f9f880d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8c8cd640 1 --2- 172.21.15.55:0/2980921351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f88162aa0 0x7f9f880d4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8c8cd640 1 -- 172.21.15.55:0/2980921351 >> v1:172.21.15.55:6789/0 conn(0x7f9f880d1d40 legacy=0x7f9f880b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f7ffff640 1 -- 172.21.15.55:0/2980921351 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862390809 0 0) 0x7f9f880d3b90 con 0x7f9f880d1d40 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.472+0000 7f9f8c8cd640 1 -- 172.21.15.55:0/2980921351 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f880d4150 con 0x7f9f880d3690 2024-05-10T03:54:30.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.473+0000 7f9f8c8cd640 1 --2- 172.21.15.55:0/2980921351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d3690 0x7f9f880bac50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f780097a0 tx=0x7f9f7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378eeddfb30b1f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.473+0000 7f9f7ffff640 1 -- 172.21.15.55:0/2980921351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78037070 con 0x7f9f880d3690 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.473+0000 7f9f7ffff640 1 -- 172.21.15.55:0/2980921351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f78032440 con 0x7f9f880d3690 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.473+0000 7f9f7ffff640 1 -- 172.21.15.55:0/2980921351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78032810 con 0x7f9f880d3690 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 -- 172.21.15.55:0/2980921351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d3690 msgr2=0x7f9f880bac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 --2- 172.21.15.55:0/2980921351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d3690 0x7f9f880bac50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f780097a0 tx=0x7f9f7802a180 comp rx=0 tx=0).stop 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 -- 172.21.15.55:0/2980921351 shutdown_connections 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 --2- 172.21.15.55:0/2980921351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d3690 0x7f9f880bac50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 --2- 172.21.15.55:0/2980921351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f88162aa0 0x7f9f880d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 -- 172.21.15.55:0/2980921351 >> 172.21.15.55:0/2980921351 conn(0x7f9f880740f0 msgr2=0x7f9f8806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 -- 172.21.15.55:0/2980921351 shutdown_connections 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.474+0000 7f9f8f332640 1 -- 172.21.15.55:0/2980921351 wait complete. 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.475+0000 7f9f8f332640 1 Processor -- start 2024-05-10T03:54:30.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.475+0000 7f9f8f332640 1 -- start start 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8f332640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 0x7f9f880ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8f332640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f880d3690 0x7f9f880cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8f332640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f88162aa0 0x7f9f880cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8f332640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9f880bb190 con 0x7f9f880d1d40 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8f332640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9f880d4710 con 0x7f9f88162aa0 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8f332640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9f880d21a0 con 0x7f9f880d3690 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 0x7f9f880ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 0x7f9f880ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34564/0 (socket says 172.21.15.55:34564) 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 -- 172.21.15.55:0/1799564339 learned_addr learned my addr 172.21.15.55:0/1799564339 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8c8cd640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f880d3690 0x7f9f880cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d8cf640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f88162aa0 0x7f9f880cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 -- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f880d3690 msgr2=0x7f9f880cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f880d3690 0x7f9f880cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 -- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f88162aa0 msgr2=0x7f9f880cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f88162aa0 0x7f9f880cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 -- 172.21.15.55:0/1799564339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f88159ad0 con 0x7f9f880d1d40 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d8cf640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f88162aa0 0x7f9f880cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8c8cd640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f880d3690 0x7f9f880cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.476+0000 7f9f8d0ce640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 0x7f9f880ced20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400d620 tx=0x7f9f8400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.477+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400b620 con 0x7f9f880d1d40 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.477+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f84019070 con 0x7f9f880d1d40 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.477+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f88159db0 con 0x7f9f880d1d40 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.477+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400ba00 con 0x7f9f880d1d40 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.477+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8814a820 con 0x7f9f880d1d40 2024-05-10T03:54:30.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.478+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8806e7a0 con 0x7f9f880d1d40 2024-05-10T03:54:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.478+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9f8400bba0 con 0x7f9f880d1d40 2024-05-10T03:54:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.479+0000 7f9f7dffb640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9f6c0762d0 0x7f9f6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.479+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f9f84097ae0 con 0x7f9f880d1d40 2024-05-10T03:54:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.479+0000 7f9f8c8cd640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9f6c0762d0 0x7f9f6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.479+0000 7f9f8c8cd640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9f6c0762d0 0x7f9f6c078790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f78034000 tx=0x7f9f7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.483+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9f84061350 con 0x7f9f880d1d40 2024-05-10T03:54:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.714+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f88159f80 con 0x7f9f880d1d40 2024-05-10T03:54:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.714+0000 7f9f7dffb640 1 -- 172.21.15.55:0/1799564339 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5158 (secure 0 0 0) 0x7f9f84060c50 con 0x7f9f880d1d40 2024-05-10T03:54:30.718 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:30.718 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/401830949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":401830949},{"type":"v1","addr":"172.21.15.55:6836","nonce":401830949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:28.881667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-10T03:54:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9f6c0762d0 msgr2=0x7f9f6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9f6c0762d0 0x7f9f6c078790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f78034000 tx=0x7f9f7802e000 comp rx=0 tx=0).stop 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 msgr2=0x7f9f880ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 0x7f9f880ced20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400d620 tx=0x7f9f8400dae0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 shutdown_connections 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f88162aa0 0x7f9f880cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f880d3690 0x7f9f880cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9f6c0762d0 0x7f9f6c078790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 --2- 172.21.15.55:0/1799564339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f880d1d40 0x7f9f880ced20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 >> 172.21.15.55:0/1799564339 conn(0x7f9f880740f0 msgr2=0x7f9f88154160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.716+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 shutdown_connections 2024-05-10T03:54:30.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.717+0000 7f9f8f332640 1 -- 172.21.15.55:0/1799564339 wait complete. 2024-05-10T03:54:30.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:54:30.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.833+0000 7fb94281d640 1 Processor -- start 2024-05-10T03:54:30.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.833+0000 7fb94281d640 1 -- start start 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb94281d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb93c162aa0 0x7fb93c0d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb94281d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb93c0d1d40 0x7fb93c0d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb94281d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb93c0d3b90 con 0x7fb93c0d3690 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb94281d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c0d5170 con 0x7fb93c0d1d40 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb94281d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c0d3e70 con 0x7fb93c162aa0 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb940dba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb93c0d1d40 0x7fb93c0d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb940dba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb93c0d1d40 0x7fb93c0d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34578/0 (socket says 172.21.15.55:34578) 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.834+0000 7fb940dba640 1 -- 172.21.15.55:0/706442961 learned_addr learned my addr 172.21.15.55:0/706442961 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb93bfff640 1 --2- 172.21.15.55:0/706442961 >> v2:172.21.15.64:3300/0 conn(0x7fb93c162aa0 0x7fb93c0d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb940dba640 1 -- 172.21.15.55:0/706442961 >> v2:172.21.15.64:3300/0 conn(0x7fb93c162aa0 msgr2=0x7fb93c0d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb940dba640 1 --2- 172.21.15.55:0/706442961 >> v2:172.21.15.64:3300/0 conn(0x7fb93c162aa0 0x7fb93c0d4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb940dba640 1 -- 172.21.15.55:0/706442961 >> v1:172.21.15.64:6789/0 conn(0x7fb93c0d3690 legacy=0x7fb93c0bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb940dba640 1 -- 172.21.15.55:0/706442961 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c0d4150 con 0x7fb93c0d1d40 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb940dba640 1 --2- 172.21.15.55:0/706442961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0d21d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb93c069dd0 tx=0x7fb93402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e6a57df15eaae2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.835+0000 7fb93affd640 1 -- 172.21.15.55:0/706442961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934036070 con 0x7fb93c0d1d40 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb93affd640 1 -- 172.21.15.55:0/706442961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb934031600 con 0x7fb93c0d1d40 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb93affd640 1 -- 172.21.15.55:0/706442961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9340319d0 con 0x7fb93c0d1d40 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 -- 172.21.15.55:0/706442961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 msgr2=0x7fb93c0d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 --2- 172.21.15.55:0/706442961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0d21d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb93c069dd0 tx=0x7fb93402a6a0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 -- 172.21.15.55:0/706442961 shutdown_connections 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 --2- 172.21.15.55:0/706442961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0d21d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 --2- 172.21.15.55:0/706442961 >> v2:172.21.15.64:3300/0 conn(0x7fb93c162aa0 0x7fb93c0d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 -- 172.21.15.55:0/706442961 >> 172.21.15.55:0/706442961 conn(0x7fb93c0740f0 msgr2=0x7fb93c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 -- 172.21.15.55:0/706442961 shutdown_connections 2024-05-10T03:54:30.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.836+0000 7fb94281d640 1 -- 172.21.15.55:0/706442961 wait complete. 2024-05-10T03:54:30.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.837+0000 7fb94281d640 1 Processor -- start 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 -- start start 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb93c0d3690 0x7fb93c0adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb93c162aa0 0x7fb93c1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c0b8460 con 0x7fb93c0d1d40 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c0d4710 con 0x7fb93c0d3690 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb94281d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c0b85e0 con 0x7fb93c162aa0 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34590/0 (socket says 172.21.15.55:34590) 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.838+0000 7fb93bfff640 1 -- 172.21.15.55:0/1771112360 learned_addr learned my addr 172.21.15.55:0/1771112360 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93bfff640 1 -- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb93c162aa0 msgr2=0x7fb93c1f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb940dba640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb93c162aa0 0x7fb93c1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93b7fe640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb93c0d3690 0x7fb93c0adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93bfff640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb93c162aa0 0x7fb93c1f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93bfff640 1 -- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb93c0d3690 msgr2=0x7fb93c0adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93bfff640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb93c0d3690 0x7fb93c0adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93bfff640 1 -- 172.21.15.55:0/1771112360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c0ae910 con 0x7fb93c0d1d40 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb93bfff640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0b38b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00d5f0 tx=0x7fb92c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0125f0 con 0x7fb93c0d1d40 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92c019070 con 0x7fb93c0d1d40 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c0aebf0 con 0x7fb93c0d1d40 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0129d0 con 0x7fb93c0d1d40 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.839+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c0af1b0 con 0x7fb93c0d1d40 2024-05-10T03:54:30.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.840+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93c06e7a0 con 0x7fb93c0d1d40 2024-05-10T03:54:30.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.841+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb92c012b70 con 0x7fb93c0d1d40 2024-05-10T03:54:30.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.841+0000 7fb938ff9640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb9280762d0 0x7fb928078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:30.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.841+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fb92c097a00 con 0x7fb93c0d1d40 2024-05-10T03:54:30.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.841+0000 7fb93b7fe640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb9280762d0 0x7fb928078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:30.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.842+0000 7fb93b7fe640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb9280762d0 0x7fb928078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb93c161b20 tx=0x7fb930009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:30.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:30.846+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb92c061390 con 0x7fb93c0d1d40 2024-05-10T03:54:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.078+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb93c050820 con 0x7fb93c0d1d40 2024-05-10T03:54:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.078+0000 7fb938ff9640 1 -- 172.21.15.55:0/1771112360 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5158 (secure 0 0 0) 0x7fb92c060c90 con 0x7fb93c0d1d40 2024-05-10T03:54:31.083 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:31.083 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/401830949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":401830949},{"type":"v1","addr":"172.21.15.55:6836","nonce":401830949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T03:54:19.076327+0000","modified":"2024-05-10T03:54:28.881667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-05-10T03:54:31.083 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb9280762d0 msgr2=0x7fb928078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb9280762d0 0x7fb928078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb93c161b20 tx=0x7fb930009040 comp rx=0 tx=0).stop 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 msgr2=0x7fb93c0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0b38b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00d5f0 tx=0x7fb92c00dab0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 shutdown_connections 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb93c162aa0 0x7fb93c1f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb93c0d3690 0x7fb93c0adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fb9280762d0 0x7fb928078790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 --2- 172.21.15.55:0/1771112360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb93c0d1d40 0x7fb93c0b38b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 >> 172.21.15.55:0/1771112360 conn(0x7fb93c0740f0 msgr2=0x7fb93c0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 shutdown_connections 2024-05-10T03:54:31.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.081+0000 7fb94281d640 1 -- 172.21.15.55:0/1771112360 wait complete. 2024-05-10T03:54:31.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:31.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 Processor -- start 2024-05-10T03:54:31.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 -- start start 2024-05-10T03:54:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4b4163cb0 0x7fa4b40d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b415f770 0x7fa4b415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b409bcb0 con 0x7fa4b4163080 2024-05-10T03:54:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b409ba60 con 0x7fa4b4163cb0 2024-05-10T03:54:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b8efc640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b409bf90 con 0x7fa4b415f770 2024-05-10T03:54:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4b4163080 0x7fa4b4163460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41592/0 (socket says 172.21.15.55:41592) 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b1d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4b4163cb0 0x7fa4b40d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b259c640 1 -- 172.21.15.55:0/1450149848 learned_addr learned my addr 172.21.15.55:0/1450149848 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b2d9d640 1 --2- 172.21.15.55:0/1450149848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b415f770 0x7fa4b415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/1450149848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b415f770 msgr2=0x7fa4b415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b1d9b640 1 --2- 172.21.15.55:0/1450149848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b415f770 0x7fa4b415fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/1450149848 >> v1:172.21.15.55:6789/0 conn(0x7fa4b4163080 legacy=0x7fa4b4163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b1d9b640 1 -- 172.21.15.55:0/1450149848 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b409c270 con 0x7fa4b4163cb0 2024-05-10T03:54:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.197+0000 7fa4b159a640 1 -- 172.21.15.55:0/1450149848 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923250956 0 0) 0x7fa4b409bcb0 con 0x7fa4b4163080 2024-05-10T03:54:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.198+0000 7fa4b1d9b640 1 --2- 172.21.15.55:0/1450149848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b4163cb0 0x7fa4b40d1d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097a0 tx=0x7fa49c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce26dffdfbdf1d5f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.198+0000 7fa4b159a640 1 -- 172.21.15.55:0/1450149848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c037070 con 0x7fa4b4163cb0 2024-05-10T03:54:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.198+0000 7fa4b159a640 1 -- 172.21.15.55:0/1450149848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49c032440 con 0x7fa4b4163cb0 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.198+0000 7fa4b159a640 1 -- 172.21.15.55:0/1450149848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c032810 con 0x7fa4b4163cb0 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1450149848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b4163cb0 msgr2=0x7fa4b40d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1450149848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b4163cb0 0x7fa4b40d1d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097a0 tx=0x7fa49c02a210 comp rx=0 tx=0).stop 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1450149848 shutdown_connections 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1450149848 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b415f770 0x7fa4b415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1450149848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b4163cb0 0x7fa4b40d1d10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1450149848 >> 172.21.15.55:0/1450149848 conn(0x7fa4b40b4d70 msgr2=0x7fa4b40b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1450149848 shutdown_connections 2024-05-10T03:54:31.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.199+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1450149848 wait complete. 2024-05-10T03:54:31.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.200+0000 7fa4b8efc640 1 Processor -- start 2024-05-10T03:54:31.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.200+0000 7fa4b8efc640 1 -- start start 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b8efc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 0x7fa4b41e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b8efc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4b4163080 0x7fa4b40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b8efc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b4163cb0 0x7fa4b40cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b8efc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40d2250 con 0x7fa4b415f770 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b8efc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b409c830 con 0x7fa4b4163080 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b8efc640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b40cef80 con 0x7fa4b4163cb0 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 0x7fa4b41e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 0x7fa4b41e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34602/0 (socket says 172.21.15.55:34602) 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b259c640 1 -- 172.21.15.55:0/1851780514 learned_addr learned my addr 172.21.15.55:0/1851780514 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b2d9d640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b4163cb0 0x7fa4b40cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.201+0000 7fa4b1d9b640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4b4163080 0x7fa4b40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b259c640 1 -- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b4163cb0 msgr2=0x7fa4b40cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b259c640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b4163cb0 0x7fa4b40cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b259c640 1 -- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4b4163080 msgr2=0x7fa4b40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b259c640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4b4163080 0x7fa4b40cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b259c640 1 -- 172.21.15.55:0/1851780514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b41600a0 con 0x7fa4b415f770 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b259c640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 0x7fa4b41e8e80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00c490 tx=0x7fa4ac00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac018070 con 0x7fa4b415f770 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ac007500 con 0x7fa4b415f770 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac004a20 con 0x7fa4b415f770 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b415e780 con 0x7fa4b415f770 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.202+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b414b5c0 con 0x7fa4b415f770 2024-05-10T03:54:31.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.203+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b40a1390 con 0x7fa4b415f770 2024-05-10T03:54:31.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.204+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa4ac01b070 con 0x7fa4b415f770 2024-05-10T03:54:31.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.204+0000 7fa4aaffd640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa4940762d0 0x7fa494078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.204+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fa4ac096910 con 0x7fa4b415f770 2024-05-10T03:54:31.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.204+0000 7fa4b1d9b640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa4940762d0 0x7fa494078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.205+0000 7fa4b1d9b640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa4940762d0 0x7fa494078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa49c034000 tx=0x7fa49c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:31.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.209+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4b41600a0 con 0x7fa4b415f770 2024-05-10T03:54:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.400+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4b4050820 con 0x7fa4b415f770 2024-05-10T03:54:31.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.401+0000 7fa4aaffd640 1 -- 172.21.15.55:0/1851780514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16702 (secure 0 0 0) 0x7fa4ac0602a0 con 0x7fa4b415f770 2024-05-10T03:54:31.405 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:31.405 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:54:28.881514+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T03:54:17.121690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T03:54:18.026924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6836/1112724499":"2024-05-11T03:54:28.881488+0000","172.21.15.55:6834/1112724499":"2024-05-11T03:54:28.881488+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa4940762d0 msgr2=0x7fa494078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa4940762d0 0x7fa494078790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa49c034000 tx=0x7fa49c02e000 comp rx=0 tx=0).stop 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 msgr2=0x7fa4b41e8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 0x7fa4b41e8e80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00c490 tx=0x7fa4ac00c950 comp rx=0 tx=0).stop 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 shutdown_connections 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4b4163cb0 0x7fa4b40cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4b4163080 0x7fa4b40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa4940762d0 0x7fa494078790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 --2- 172.21.15.55:0/1851780514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b415f770 0x7fa4b41e8e80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 >> 172.21.15.55:0/1851780514 conn(0x7fa4b40b4d70 msgr2=0x7fa4b40b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 shutdown_connections 2024-05-10T03:54:31.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.404+0000 7fa4b8efc640 1 -- 172.21.15.55:0/1851780514 wait complete. 2024-05-10T03:54:31.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T03:54:31.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.520+0000 7efd145da640 1 Processor -- start 2024-05-10T03:54:31.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.520+0000 7efd145da640 1 -- start start 2024-05-10T03:54:31.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd145da640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efd0c15cca0 0x7efd0c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd145da640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 0x7efd0c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd145da640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0c160820 con 0x7efd0c162eb0 2024-05-10T03:54:31.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd145da640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7efd0c15fc80 con 0x7efd0c15cca0 2024-05-10T03:54:31.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd145da640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efd0c06cd10 con 0x7efd0c06c390 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efd0c15cca0 0x7efd0c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12b77640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 0x7efd0c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efd0c15cca0 0x7efd0c0712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:46974/0 (socket says 172.21.15.55:46974) 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12b77640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 0x7efd0c06c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:44300/0 (socket says 172.21.15.55:44300) 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 -- 172.21.15.55:0/236622554 learned_addr learned my addr 172.21.15.55:0/236622554 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd11b75640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7efd0c162eb0 0x7efd0c160110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49310/0 (socket says 172.21.15.55:49310) 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 -- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 msgr2=0x7efd0c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 --2- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 0x7efd0c06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 -- 172.21.15.55:0/236622554 >> v1:172.21.15.64:6789/0 conn(0x7efd0c162eb0 legacy=0x7efd0c160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd11374640 1 -- 172.21.15.55:0/236622554 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286899782 0 0) 0x7efd0c160820 con 0x7efd0c162eb0 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12376640 1 -- 172.21.15.55:0/236622554 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c15f930 con 0x7efd0c15cca0 2024-05-10T03:54:31.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.521+0000 7efd12b77640 1 --2- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 0x7efd0c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:31.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd12376640 1 --2- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c15cca0 0x7efd0c0712c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd04009870 tx=0x7efd0402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fee041bc6ea149 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd11374640 1 -- 172.21.15.55:0/236622554 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04037070 con 0x7efd0c15cca0 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd11374640 1 -- 172.21.15.55:0/236622554 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd04032440 con 0x7efd0c15cca0 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd11374640 1 -- 172.21.15.55:0/236622554 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04032810 con 0x7efd0c15cca0 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 -- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c15cca0 msgr2=0x7efd0c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 --2- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c15cca0 0x7efd0c0712c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd04009870 tx=0x7efd0402a270 comp rx=0 tx=0).stop 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 -- 172.21.15.55:0/236622554 shutdown_connections 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 --2- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c06c390 0x7efd0c06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 --2- 172.21.15.55:0/236622554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c15cca0 0x7efd0c0712c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 -- 172.21.15.55:0/236622554 >> 172.21.15.55:0/236622554 conn(0x7efd0c06ddc0 msgr2=0x7efd0c0b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 -- 172.21.15.55:0/236622554 shutdown_connections 2024-05-10T03:54:31.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.523+0000 7efd145da640 1 -- 172.21.15.55:0/236622554 wait complete. 2024-05-10T03:54:31.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 Processor -- start 2024-05-10T03:54:31.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 -- start start 2024-05-10T03:54:31.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c06c390 0x7efd0c1626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 0x7efd0c13c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c162eb0 0x7efd0c0c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c163c50 con 0x7efd0c15cca0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c163970 con 0x7efd0c06c390 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd145da640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efd0c163320 con 0x7efd0c162eb0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.525+0000 7efd11b75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 0x7efd0c13c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 0x7efd0c13c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34616/0 (socket says 172.21.15.55:34616) 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 -- 172.21.15.55:0/806927804 learned_addr learned my addr 172.21.15.55:0/806927804 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd12376640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c06c390 0x7efd0c1626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd12b77640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c162eb0 0x7efd0c0c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 -- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c162eb0 msgr2=0x7efd0c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c162eb0 0x7efd0c0c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 -- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c06c390 msgr2=0x7efd0c1626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c06c390 0x7efd0c1626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 -- 172.21.15.55:0/806927804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c160bc0 con 0x7efd0c15cca0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd11b75640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 0x7efd0c13c690 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c410 tx=0x7efcfc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0074e0 con 0x7efd0c15cca0 2024-05-10T03:54:31.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc0047e0 con 0x7efd0c15cca0 2024-05-10T03:54:31.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c160e60 con 0x7efd0c15cca0 2024-05-10T03:54:31.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc004bd0 con 0x7efd0c15cca0 2024-05-10T03:54:31.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.526+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c161420 con 0x7efd0c15cca0 2024-05-10T03:54:31.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.527+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0c161620 con 0x7efd0c15cca0 2024-05-10T03:54:31.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.528+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcfc011070 con 0x7efd0c15cca0 2024-05-10T03:54:31.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.528+0000 7efd02ffd640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efcf00762d0 0x7efcf0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:31.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.528+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7efcfc097270 con 0x7efd0c15cca0 2024-05-10T03:54:31.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.528+0000 7efd12376640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efcf00762d0 0x7efcf0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:31.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.528+0000 7efd12376640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efcf00762d0 0x7efcf0078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd04034000 tx=0x7efd0402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:31.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.533+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd0c161620 con 0x7efd0c15cca0 2024-05-10T03:54:31.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.764+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efd0c0b61e0 con 0x7efd0c15cca0 2024-05-10T03:54:31.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.901+0000 7efd02ffd640 1 -- 172.21.15.55:0/806927804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7efcfc060b60 con 0x7efd0c15cca0 2024-05-10T03:54:31.904 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T03:54:31.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efcf00762d0 msgr2=0x7efcf0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efcf00762d0 0x7efcf0078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd04034000 tx=0x7efd0402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 msgr2=0x7efd0c13c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 0x7efd0c13c690 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c410 tx=0x7efcfc00c8d0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 shutdown_connections 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efd0c162eb0 0x7efd0c0c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7efcf00762d0 0x7efcf0078790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd0c15cca0 0x7efd0c13c690 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 --2- 172.21.15.55:0/806927804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd0c06c390 0x7efd0c1626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 >> 172.21.15.55:0/806927804 conn(0x7efd0c06ddc0 msgr2=0x7efd0c0b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 shutdown_connections 2024-05-10T03:54:31.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:31.904+0000 7efd145da640 1 -- 172.21.15.55:0/806927804 wait complete. 2024-05-10T03:54:31.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T03:54:32.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.021+0000 7f527f738640 1 Processor -- start 2024-05-10T03:54:32.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.021+0000 7f527f738640 1 -- start start 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527f738640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f527815f450 0x7f52780cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527f738640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52780b5910 0x7f52780d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527f738640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52780b5da0 con 0x7f527815f830 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527f738640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f5278163460 con 0x7f527815f450 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527f738640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f52780b6080 con 0x7f52780b5910 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f527815f450 0x7f52780cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:32.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f527815f450 0x7f52780cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34620/0 (socket says 172.21.15.55:34620) 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 -- 172.21.15.55:0/1330630806 learned_addr learned my addr 172.21.15.55:0/1330630806 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527dcd5640 1 --2- 172.21.15.55:0/1330630806 >> v2:172.21.15.64:3300/0 conn(0x7f52780b5910 0x7f52780d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 -- 172.21.15.55:0/1330630806 >> v2:172.21.15.64:3300/0 conn(0x7f52780b5910 msgr2=0x7f52780d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 --2- 172.21.15.55:0/1330630806 >> v2:172.21.15.64:3300/0 conn(0x7f52780b5910 0x7f52780d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 -- 172.21.15.55:0/1330630806 >> v1:172.21.15.64:6789/0 conn(0x7f527815f830 legacy=0x7f52780b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527d4d4640 1 -- 172.21.15.55:0/1330630806 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52780d3020 con 0x7f527815f450 2024-05-10T03:54:32.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.022+0000 7f527dcd5640 1 --2- 172.21.15.55:0/1330630806 >> v2:172.21.15.64:3300/0 conn(0x7f52780b5910 0x7f52780d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:32.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.023+0000 7f527d4d4640 1 --2- 172.21.15.55:0/1330630806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f450 0x7f52780cfe70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52780cfc40 tx=0x7f527402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5105ceb969995 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.023+0000 7f526ffff640 1 -- 172.21.15.55:0/1330630806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274037070 con 0x7f527815f450 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.023+0000 7f526ffff640 1 -- 172.21.15.55:0/1330630806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5274032440 con 0x7f527815f450 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.023+0000 7f526ffff640 1 -- 172.21.15.55:0/1330630806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274032810 con 0x7f527815f450 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 -- 172.21.15.55:0/1330630806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f450 msgr2=0x7f52780cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 --2- 172.21.15.55:0/1330630806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f450 0x7f52780cfe70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52780cfc40 tx=0x7f527402a1e0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 -- 172.21.15.55:0/1330630806 shutdown_connections 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 --2- 172.21.15.55:0/1330630806 >> v2:172.21.15.64:3300/0 conn(0x7f52780b5910 0x7f52780d5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 --2- 172.21.15.55:0/1330630806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f450 0x7f52780cfe70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 -- 172.21.15.55:0/1330630806 >> 172.21.15.55:0/1330630806 conn(0x7f527808ec90 msgr2=0x7f527809e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 -- 172.21.15.55:0/1330630806 shutdown_connections 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.024+0000 7f527f738640 1 -- 172.21.15.55:0/1330630806 wait complete. 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.025+0000 7f527f738640 1 Processor -- start 2024-05-10T03:54:32.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.025+0000 7f527f738640 1 -- start start 2024-05-10T03:54:32.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527f738640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f527815f450 0x7f5278151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527f738640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 0x7f52781f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527f738640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5278160c90 0x7f527806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527f738640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f52780d0530 con 0x7f527815f830 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527f738640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f52780d03b0 con 0x7f5278160c90 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527f738640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f52780d57a0 con 0x7f527815f450 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 0x7f52781f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 0x7f52781f9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34630/0 (socket says 172.21.15.55:34630) 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 -- 172.21.15.55:0/2388517525 learned_addr learned my addr 172.21.15.55:0/2388517525 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527dcd5640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5278160c90 0x7f527806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527d4d4640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f527815f450 0x7f5278151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 -- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f527815f450 msgr2=0x7f5278151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f527815f450 0x7f5278151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 -- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5278160c90 msgr2=0x7f527806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5278160c90 0x7f527806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 -- 172.21.15.55:0/2388517525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5278161250 con 0x7f527815f830 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527dcd5640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5278160c90 0x7f527806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.026+0000 7f527ccd3640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 0x7f52781f9560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f526800b3c0 tx=0x7f526800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.027+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268011830 con 0x7f527815f830 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.027+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5268016070 con 0x7f527815f830 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.027+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5278161530 con 0x7f527815f830 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.027+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268011c10 con 0x7f527815f830 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.027+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5278161af0 con 0x7f527815f830 2024-05-10T03:54:32.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.028+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52780d5b80 con 0x7f527815f830 2024-05-10T03:54:32.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.029+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f526801b460 con 0x7f527815f830 2024-05-10T03:54:32.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.029+0000 7f526dffb640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f525c0762d0 0x7f525c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:32.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.029+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f5268097060 con 0x7f527815f830 2024-05-10T03:54:32.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.029+0000 7f527d4d4640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f525c0762d0 0x7f525c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:32.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.030+0000 7f527d4d4640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f525c0762d0 0x7f525c078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5274034000 tx=0x7f527402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:32.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.033+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52780d5b80 con 0x7f527815f830 2024-05-10T03:54:32.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.264+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f52780cf7d0 con 0x7f527815f830 2024-05-10T03:54:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.903+0000 7f526dffb640 1 -- 172.21.15.55:0/2388517525 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f52780cf7d0 con 0x7f527815f830 2024-05-10T03:54:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f525c0762d0 msgr2=0x7f525c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f525c0762d0 0x7f525c078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5274034000 tx=0x7f527402e000 comp rx=0 tx=0).stop 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 msgr2=0x7f52781f9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 0x7f52781f9560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f526800b3c0 tx=0x7f526800b880 comp rx=0 tx=0).stop 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 shutdown_connections 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5278160c90 0x7f527806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f525c0762d0 0x7f525c078790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527815f830 0x7f52781f9560 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 --2- 172.21.15.55:0/2388517525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f527815f450 0x7f5278151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 >> 172.21.15.55:0/2388517525 conn(0x7f527808ec90 msgr2=0x7f52780b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 shutdown_connections 2024-05-10T03:54:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:32.906+0000 7f527f738640 1 -- 172.21.15.55:0/2388517525 wait complete. 2024-05-10T03:54:32.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T03:54:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.031+0000 7fa5cf4b4640 1 Processor -- start 2024-05-10T03:54:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.031+0000 7fa5cf4b4640 1 -- start start 2024-05-10T03:54:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cf4b4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5c80d2520 0x7fa5c80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cf4b4640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c815fa60 con 0x7fa5c81607a0 2024-05-10T03:54:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cf4b4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c806f2d0 con 0x7fa5c80d2900 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cf4b4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c815fce0 con 0x7fa5c80d2520 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cd250640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5c80d2520 0x7fa5c80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cca4f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5c81607a0 0x7fa5c806e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41598/0 (socket says 172.21.15.55:41598) 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.032+0000 7fa5cca4f640 1 -- 172.21.15.55:0/1440171373 learned_addr learned my addr 172.21.15.55:0/1440171373 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5cd250640 1 -- 172.21.15.55:0/1440171373 >> v1:172.21.15.64:6789/0 conn(0x7fa5c80d2900 legacy=0x7fa5c8163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5cd250640 1 -- 172.21.15.55:0/1440171373 >> v1:172.21.15.55:6789/0 conn(0x7fa5c81607a0 legacy=0x7fa5c806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5c7fff640 1 -- 172.21.15.55:0/1440171373 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288869582 0 0) 0x7fa5bc001110 con 0x7fa5c81607a0 2024-05-10T03:54:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5cd250640 1 -- 172.21.15.55:0/1440171373 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c815ffc0 con 0x7fa5c80d2520 2024-05-10T03:54:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5cd250640 1 --2- 172.21.15.55:0/1440171373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c80d2520 0x7fa5c80b5020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e63f725905f5ad1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5c7fff640 1 -- 172.21.15.55:0/1440171373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8007740 con 0x7fa5c80d2520 2024-05-10T03:54:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.033+0000 7fa5c7fff640 1 -- 172.21.15.55:0/1440171373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b80078e0 con 0x7fa5c80d2520 2024-05-10T03:54:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5c7fff640 1 -- 172.21.15.55:0/1440171373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8007cb0 con 0x7fa5c80d2520 2024-05-10T03:54:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/1440171373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c80d2520 msgr2=0x7fa5c80b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/1440171373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c80d2520 0x7fa5c80b5020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009d90 tx=0x7fa5b802a6f0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/1440171373 shutdown_connections 2024-05-10T03:54:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/1440171373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c80d2520 0x7fa5c80b5020 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/1440171373 >> 172.21.15.55:0/1440171373 conn(0x7fa5c806c780 msgr2=0x7fa5c806cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/1440171373 shutdown_connections 2024-05-10T03:54:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.034+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/1440171373 wait complete. 2024-05-10T03:54:33.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.035+0000 7fa5cf4b4640 1 Processor -- start 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.035+0000 7fa5cf4b4640 1 -- start start 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cf4b4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5c80d2520 0x7fa5c815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cf4b4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5c80d2900 0x7fa5c8157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cf4b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 0x7fa5c80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cf4b4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c806ee00 con 0x7fa5c8157f70 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cf4b4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c806ec80 con 0x7fa5c80d2520 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cf4b4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c806ef80 con 0x7fa5c80d2900 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 0x7fa5c80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 0x7fa5c80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34648/0 (socket says 172.21.15.55:34648) 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 -- 172.21.15.55:0/3722134348 learned_addr learned my addr 172.21.15.55:0/3722134348 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cd250640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5c80d2520 0x7fa5c815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cca4f640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5c80d2900 0x7fa5c8157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 -- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5c80d2900 msgr2=0x7fa5c8157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:33.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5c80d2900 0x7fa5c8157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 -- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5c80d2520 msgr2=0x7fa5c815a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.036+0000 7fa5cda51640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5c80d2520 0x7fa5c815a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5cda51640 1 -- 172.21.15.55:0/3722134348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80cc280 con 0x7fa5c8157f70 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5cca4f640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5c80d2900 0x7fa5c8157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5cd250640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5c80d2520 0x7fa5c815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5cda51640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 0x7fa5c80cd320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000c400 tx=0x7fa5c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0017070 con 0x7fa5c8157f70 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c00052d0 con 0x7fa5c8157f70 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00037f0 con 0x7fa5c8157f70 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c80cc560 con 0x7fa5c8157f70 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.037+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c80ccb20 con 0x7fa5c8157f70 2024-05-10T03:54:33.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.038+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c806a7e0 con 0x7fa5c8157f70 2024-05-10T03:54:33.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.038+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5c001a070 con 0x7fa5c8157f70 2024-05-10T03:54:33.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.039+0000 7fa5c5ffb640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5b40762d0 0x7fa5b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:33.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.039+0000 7fa5cd250640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5b40762d0 0x7fa5b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:33.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.039+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fa5c0096980 con 0x7fa5c8157f70 2024-05-10T03:54:33.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.040+0000 7fa5cd250640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5b40762d0 0x7fa5b4078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034000 tx=0x7fa5b802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:33.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.044+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5c005fba0 con 0x7fa5c8157f70 2024-05-10T03:54:33.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.233+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa5c80d0a30 con 0x7fa5c8157f70 2024-05-10T03:54:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.910+0000 7fa5c5ffb640 1 -- 172.21.15.55:0/3722134348 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) ==== 181+0+0 (secure 0 0 0) 0x7fa5c0068270 con 0x7fa5c8157f70 2024-05-10T03:54:33.913 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5b40762d0 msgr2=0x7fa5b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5b40762d0 0x7fa5b4078790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034000 tx=0x7fa5b802f000 comp rx=0 tx=0).stop 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 msgr2=0x7fa5c80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 0x7fa5c80cd320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000c400 tx=0x7fa5c000c8c0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 shutdown_connections 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa5b40762d0 0x7fa5b4078790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5c8157f70 0x7fa5c80cd320 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa5c80d2900 0x7fa5c8157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 --2- 172.21.15.55:0/3722134348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5c80d2520 0x7fa5c815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 >> 172.21.15.55:0/3722134348 conn(0x7fa5c806c780 msgr2=0x7fa5c80b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 shutdown_connections 2024-05-10T03:54:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:33.914+0000 7fa5cf4b4640 1 -- 172.21.15.55:0/3722134348 wait complete. 2024-05-10T03:54:33.932 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T03:54:34.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.048+0000 7f59253b7640 1 Processor -- start 2024-05-10T03:54:34.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.048+0000 7f59253b7640 1 -- start start 2024-05-10T03:54:34.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f59253b7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f59200d01a0 0x7f5920072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:34.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f59253b7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5920072a50 0x7f59200b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:34.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f59253b7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5920073280 con 0x7f59200b2b70 2024-05-10T03:54:34.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f59253b7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f59200cf3e0 con 0x7f5920072a50 2024-05-10T03:54:34.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f59253b7640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f59200cf6c0 con 0x7f59200d01a0 2024-05-10T03:54:34.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5920072a50 0x7f59200b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59200b2b70 0x7f59200b2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41602/0 (socket says 172.21.15.55:41602) 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591effd640 1 -- 172.21.15.55:0/1649523751 learned_addr learned my addr 172.21.15.55:0/1649523751 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591e7fc640 1 --2- 172.21.15.55:0/1649523751 >> v2:172.21.15.64:3300/0 conn(0x7f59200d01a0 0x7f5920072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591f7fe640 1 -- 172.21.15.55:0/1649523751 >> v2:172.21.15.64:3300/0 conn(0x7f59200d01a0 msgr2=0x7f5920072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591f7fe640 1 --2- 172.21.15.55:0/1649523751 >> v2:172.21.15.64:3300/0 conn(0x7f59200d01a0 0x7f5920072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591f7fe640 1 -- 172.21.15.55:0/1649523751 >> v1:172.21.15.55:6789/0 conn(0x7f59200b2b70 legacy=0x7f59200b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591f7fe640 1 -- 172.21.15.55:0/1649523751 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59200cf9a0 con 0x7f5920072a50 2024-05-10T03:54:34.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.049+0000 7f591dffb640 1 -- 172.21.15.55:0/1649523751 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535646509 0 0) 0x7f5920073280 con 0x7f59200b2b70 2024-05-10T03:54:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.050+0000 7f591f7fe640 1 --2- 172.21.15.55:0/1649523751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5920072a50 0x7f59200b3fe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5918009d90 tx=0x7f591802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b476199c9bea1c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:34.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.050+0000 7f591dffb640 1 -- 172.21.15.55:0/1649523751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918007740 con 0x7f5920072a50 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.050+0000 7f591dffb640 1 -- 172.21.15.55:0/1649523751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59180078e0 con 0x7f5920072a50 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.050+0000 7f591dffb640 1 -- 172.21.15.55:0/1649523751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918007cb0 con 0x7f5920072a50 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 -- 172.21.15.55:0/1649523751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5920072a50 msgr2=0x7f59200b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 --2- 172.21.15.55:0/1649523751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5920072a50 0x7f59200b3fe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5918009d90 tx=0x7f591802a6a0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 -- 172.21.15.55:0/1649523751 shutdown_connections 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 --2- 172.21.15.55:0/1649523751 >> v2:172.21.15.64:3300/0 conn(0x7f59200d01a0 0x7f5920072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 --2- 172.21.15.55:0/1649523751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5920072a50 0x7f59200b3fe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 -- 172.21.15.55:0/1649523751 >> 172.21.15.55:0/1649523751 conn(0x7f592006f860 msgr2=0x7f592006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 -- 172.21.15.55:0/1649523751 shutdown_connections 2024-05-10T03:54:34.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.051+0000 7f59253b7640 1 -- 172.21.15.55:0/1649523751 wait complete. 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.052+0000 7f59253b7640 1 Processor -- start 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.052+0000 7f59253b7640 1 -- start start 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f59253b7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5920072a50 0x7f592015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f59253b7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f59200b2b70 0x7f5920157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f59253b7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 0x7f592015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f59253b7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5920145e40 con 0x7f59200d01a0 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f59253b7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5920145cc0 con 0x7f5920072a50 2024-05-10T03:54:34.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f59253b7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5920072ee0 con 0x7f59200b2b70 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f591f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 0x7f592015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f591f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 0x7f592015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34666/0 (socket says 172.21.15.55:34666) 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f591f7fe640 1 -- 172.21.15.55:0/1521245952 learned_addr learned my addr 172.21.15.55:0/1521245952 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f591effd640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5920072a50 0x7f592015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.053+0000 7f591e7fc640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f59200b2b70 0x7f5920157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f591f7fe640 1 -- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f59200b2b70 msgr2=0x7f5920157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f591f7fe640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f59200b2b70 0x7f5920157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f591f7fe640 1 -- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5920072a50 msgr2=0x7f592015c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f591f7fe640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5920072a50 0x7f592015c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f591f7fe640 1 -- 172.21.15.55:0/1521245952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592015ce70 con 0x7f59200d01a0 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f591f7fe640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 0x7f592015df10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f591802ac90 tx=0x7f5918004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591803f070 con 0x7f59200d01a0 2024-05-10T03:54:34.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5918031bc0 con 0x7f59200d01a0 2024-05-10T03:54:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918009450 con 0x7f59200d01a0 2024-05-10T03:54:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592015d150 con 0x7f59200d01a0 2024-05-10T03:54:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.054+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592015d710 con 0x7f59200d01a0 2024-05-10T03:54:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.055+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592006a7e0 con 0x7f59200d01a0 2024-05-10T03:54:34.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.056+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f591803b410 con 0x7f59200d01a0 2024-05-10T03:54:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.056+0000 7f59177fe640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59000762d0 0x7f5900078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:34.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.056+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5357+0+0 (secure 0 0 0) 0x7f59180b8ad0 con 0x7f59200d01a0 2024-05-10T03:54:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.056+0000 7f591effd640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59000762d0 0x7f5900078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:34.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.057+0000 7f591effd640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59000762d0 0x7f5900078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5908007fd0 tx=0x7f5908007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:34.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.061+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5918081f30 con 0x7f59200d01a0 2024-05-10T03:54:34.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.252+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f592006d020 con 0x7f59200d01a0 2024-05-10T03:54:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.922+0000 7f59177fe640 1 -- 172.21.15.55:0/1521245952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) ==== 169+0+0 (secure 0 0 0) 0x7f5918086230 con 0x7f59200d01a0 2024-05-10T03:54:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-05-10T03:54:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59000762d0 msgr2=0x7f5900078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59000762d0 0x7f5900078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5908007fd0 tx=0x7f5908007de0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 msgr2=0x7f592015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 0x7f592015df10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f591802ac90 tx=0x7f5918004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 shutdown_connections 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59000762d0 0x7f5900078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59200d01a0 0x7f592015df10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f59200b2b70 0x7f5920157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 --2- 172.21.15.55:0/1521245952 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5920072a50 0x7f592015c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 >> 172.21.15.55:0/1521245952 conn(0x7f592006f860 msgr2=0x7f59200b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 shutdown_connections 2024-05-10T03:54:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:34.926+0000 7f59253b7640 1 -- 172.21.15.55:0/1521245952 wait complete. 2024-05-10T03:54:34.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T03:54:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.054+0000 7f1467778640 1 Processor -- start 2024-05-10T03:54:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.055+0000 7f1467778640 1 -- start start 2024-05-10T03:54:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.055+0000 7f1467778640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 0x7f14600b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.055+0000 7f1467778640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14600cf9c0 0x7f14600cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.055+0000 7f1467778640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146013f520 con 0x7f146013f140 2024-05-10T03:54:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.055+0000 7f1467778640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f1460142680 con 0x7f14600cf9c0 2024-05-10T03:54:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.055+0000 7f1467778640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f146015c650 con 0x7f14600b2cc0 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465d15640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14600cf9c0 0x7f14600cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1464d13640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 0x7f14600b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465514640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f146013f140 0x7f1460141f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49330/0 (socket says 172.21.15.55:49330) 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465514640 1 -- 172.21.15.55:0/1949923282 learned_addr learned my addr 172.21.15.55:0/1949923282 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1464d13640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 0x7f14600b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:44348/0 (socket says 172.21.15.55:44348) 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465d15640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14600cf9c0 0x7f14600cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:47030/0 (socket says 172.21.15.55:47030) 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1457fff640 1 -- 172.21.15.55:0/1949923282 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77808044 0 0) 0x7f146013f520 con 0x7f146013f140 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1457fff640 1 -- 172.21.15.55:0/1949923282 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f144c003520 con 0x7f146013f140 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465d15640 1 -- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 msgr2=0x7f14600b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:35.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465d15640 1 --2- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 0x7f14600b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465d15640 1 -- 172.21.15.55:0/1949923282 >> v1:172.21.15.64:6789/0 conn(0x7f146013f140 legacy=0x7f1460141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1465d15640 1 -- 172.21.15.55:0/1949923282 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146015c910 con 0x7f14600cf9c0 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.056+0000 7f1464d13640 1 --2- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 0x7f14600b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.057+0000 7f1465d15640 1 --2- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600cfe50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1458009d90 tx=0x7f145802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41435b61553c5694 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.057+0000 7f1457fff640 1 -- 172.21.15.55:0/1949923282 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458007740 con 0x7f14600cf9c0 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.057+0000 7f1457fff640 1 -- 172.21.15.55:0/1949923282 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14580078e0 con 0x7f14600cf9c0 2024-05-10T03:54:35.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.057+0000 7f1457fff640 1 -- 172.21.15.55:0/1949923282 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458007cb0 con 0x7f14600cf9c0 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 -- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 msgr2=0x7f14600cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 --2- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600cfe50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1458009d90 tx=0x7f145802a660 comp rx=0 tx=0).stop 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 -- 172.21.15.55:0/1949923282 shutdown_connections 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 --2- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600cfe50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 --2- 172.21.15.55:0/1949923282 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14600b2cc0 0x7f14600b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 -- 172.21.15.55:0/1949923282 >> 172.21.15.55:0/1949923282 conn(0x7f146006fac0 msgr2=0x7f146006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:35.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 -- 172.21.15.55:0/1949923282 shutdown_connections 2024-05-10T03:54:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.058+0000 7f1467778640 1 -- 172.21.15.55:0/1949923282 wait complete. 2024-05-10T03:54:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.059+0000 7f1467778640 1 Processor -- start 2024-05-10T03:54:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.059+0000 7f1467778640 1 -- start start 2024-05-10T03:54:35.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1467778640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 0x7f1460155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1467778640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1467778640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f146013f140 0x7f14600b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1467778640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f146015d1b0 con 0x7f14600b2cc0 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1467778640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f146015ced0 con 0x7f14600cf9c0 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1467778640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1460141a00 con 0x7f146013f140 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 0x7f1460155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 0x7f1460155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34674/0 (socket says 172.21.15.55:34674) 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 -- 172.21.15.55:0/515387478 learned_addr learned my addr 172.21.15.55:0/515387478 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1464d13640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465d15640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f146013f140 0x7f14600b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 -- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f146013f140 msgr2=0x7f14600b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f146013f140 0x7f14600b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 -- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 msgr2=0x7f14600b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.060+0000 7f1465514640 1 -- 172.21.15.55:0/515387478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1460155e50 con 0x7f14600b2cc0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.061+0000 7f1465514640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 0x7f1460155910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c410 tx=0x7f145c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.061+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c017070 con 0x7f14600b2cc0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.061+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c005ce0 con 0x7f14600b2cc0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.061+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14600b3f50 con 0x7f14600b2cc0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.061+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0072d0 con 0x7f14600b2cc0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.061+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14600b4510 con 0x7f14600b2cc0 2024-05-10T03:54:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.062+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146006a7e0 con 0x7f14600b2cc0 2024-05-10T03:54:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.063+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f145c01a070 con 0x7f14600b2cc0 2024-05-10T03:54:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.063+0000 7f1455ffb640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14440762d0 0x7f1444078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.063+0000 7f1464d13640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14440762d0 0x7f1444078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.063+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f145c0964e0 con 0x7f14600b2cc0 2024-05-10T03:54:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.064+0000 7f1464d13640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14440762d0 0x7f1444078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1450009560 tx=0x7f1450009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:35.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.068+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1460155e50 con 0x7f14600b2cc0 2024-05-10T03:54:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.262+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f14600cf590 con 0x7f14600b2cc0 2024-05-10T03:54:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.266+0000 7f1455ffb640 1 -- 172.21.15.55:0/515387478 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f145c05fb80 con 0x7f14600b2cc0 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14440762d0 msgr2=0x7f1444078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14440762d0 0x7f1444078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1450009560 tx=0x7f1450009190 comp rx=0 tx=0).stop 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 msgr2=0x7f1460155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 0x7f1460155910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c410 tx=0x7f145c00c8d0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 shutdown_connections 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f146013f140 0x7f14600b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14600cf9c0 0x7f14600b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14440762d0 0x7f1444078790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 --2- 172.21.15.55:0/515387478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14600b2cc0 0x7f1460155910 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 >> 172.21.15.55:0/515387478 conn(0x7f146006fac0 msgr2=0x7f146006e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 shutdown_connections 2024-05-10T03:54:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.268+0000 7f1467778640 1 -- 172.21.15.55:0/515387478 wait complete. 2024-05-10T03:54:35.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-05-10T03:54:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.384+0000 7f372cdf0640 1 Processor -- start 2024-05-10T03:54:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.384+0000 7f372cdf0640 1 -- start start 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f372cdf0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 0x7f37280cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f372cdf0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372809bd40 con 0x7f37280b4620 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f372cdf0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37280cf690 con 0x7f3728160af0 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f372cdf0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3728160ed0 con 0x7f37280d1860 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f3726d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37280b4620 0x7f37280cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41614/0 (socket says 172.21.15.55:41614) 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f3726d9d640 1 -- 172.21.15.55:0/3243167205 learned_addr learned my addr 172.21.15.55:0/3243167205 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f371ffff640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 0x7f37280cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393154955 0 0) 0x7f372809bd40 con 0x7f37280b4620 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3714003520 con 0x7f37280b4620 2024-05-10T03:54:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.385+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2948393769 0 0) 0x7f3714003520 con 0x7f37280b4620 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 msgr2=0x7f37280cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 0x7f37280cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 >> v1:172.21.15.64:6789/0 conn(0x7f3728160af0 legacy=0x7f37280d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280b2b30 con 0x7f37280b4620 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f3720001a70 con 0x7f37280b4620 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 >> v1:172.21.15.55:6789/0 conn(0x7f37280b4620 legacy=0x7f37280cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714003a30 0x7f3714003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3714004800 0x7f3714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 0x7f3714005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f371400bac0 con 0x7f3714004800 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f371400bc70 con 0x7f3714003a30 2024-05-10T03:54:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f371400be70 con 0x7f37280d1860 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f371ffff640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3714004800 0x7f3714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f372659c640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714003a30 0x7f3714003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f3726d9d640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 0x7f3714005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f371ffff640 1 -- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 msgr2=0x7f3714005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f371ffff640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280d1860 0x7f3714005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f371ffff640 1 -- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714003a30 msgr2=0x7f3714003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f371ffff640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714003a30 0x7f3714003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.386+0000 7f371ffff640 1 -- 172.21.15.55:0/3243167205 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3714003520 con 0x7f3714004800 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f371ffff640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3714004800 0x7f3714004c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3710009ac0 tx=0x7f3714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c3b70b7b3f8de4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710036070 con 0x7f3714004800 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3710031400 con 0x7f3714004800 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f3725d9b640 1 -- 172.21.15.55:0/3243167205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710009690 con 0x7f3714004800 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f372cdf0640 1 -- 172.21.15.55:0/3243167205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3714004800 msgr2=0x7f3714004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3243167205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3714004800 0x7f3714004c80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3710009ac0 tx=0x7f3714005830 comp rx=0 tx=0).stop 2024-05-10T03:54:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.387+0000 7f3726d9d640 1 -- 172.21.15.55:0/3243167205 reap_dead start 2024-05-10T03:54:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.388+0000 7f372cdf0640 1 -- 172.21.15.55:0/3243167205 shutdown_connections 2024-05-10T03:54:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.388+0000 7f372cdf0640 1 -- 172.21.15.55:0/3243167205 >> 172.21.15.55:0/3243167205 conn(0x7f37280b4b40 msgr2=0x7f37280b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.388+0000 7f372cdf0640 1 -- 172.21.15.55:0/3243167205 shutdown_connections 2024-05-10T03:54:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.388+0000 7f372cdf0640 1 -- 172.21.15.55:0/3243167205 wait complete. 2024-05-10T03:54:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.389+0000 7f372cdf0640 1 Processor -- start 2024-05-10T03:54:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.389+0000 7f372cdf0640 1 -- start start 2024-05-10T03:54:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714004800 0x7f37280ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280ccfa0 0x7f37280ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 0x7f37281ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f37280cda10 con 0x7f37281ecc50 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f37280b30f0 con 0x7f3714004800 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f37280cdb90 con 0x7f37280ccfa0 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 0x7f37281ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 0x7f37281ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34694/0 (socket says 172.21.15.55:34694) 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 -- 172.21.15.55:0/3290611838 learned_addr learned my addr 172.21.15.55:0/3290611838 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f371ffff640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280ccfa0 0x7f37280ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372659c640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714004800 0x7f37280ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 -- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280ccfa0 msgr2=0x7f37280ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280ccfa0 0x7f37280ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 -- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714004800 msgr2=0x7f37280ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714004800 0x7f37280ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 -- 172.21.15.55:0/3290611838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37280b7ec0 con 0x7f37281ecc50 2024-05-10T03:54:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f371ffff640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280ccfa0 0x7f37280ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f3726d9d640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 0x7f37281ed0e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3714004780 tx=0x7f3720007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372000aba0 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3720018070 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37280b81a0 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37200133f0 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.390+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372814d400 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.391+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372806a7e0 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.392+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3720013590 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.392+0000 7f371effd640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3708076300 0x7f37080787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.393+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f37200978a0 con 0x7f37281ecc50 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.393+0000 7f372659c640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3708076300 0x7f37080787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.393+0000 7f372659c640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3708076300 0x7f37080787c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3718000c00 tx=0x7f3718009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.397+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3720061590 con 0x7f37281ecc50 2024-05-10T03:54:35.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.668+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7f37280b5910 con 0x7f37281ecc50 2024-05-10T03:54:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.930+0000 7f371effd640 1 -- 172.21.15.55:0/3290611838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v74) ==== 123+0+0 (secure 0 0 0) 0x7f3720060e90 con 0x7f37281ecc50 2024-05-10T03:54:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3708076300 msgr2=0x7f37080787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3708076300 0x7f37080787c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3718000c00 tx=0x7f3718009040 comp rx=0 tx=0).stop 2024-05-10T03:54:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 msgr2=0x7f37281ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 0x7f37281ed0e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3714004780 tx=0x7f3720007b20 comp rx=0 tx=0).stop 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 shutdown_connections 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3708076300 0x7f37080787c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37281ecc50 0x7f37281ed0e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f37280ccfa0 0x7f37280ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 --2- 172.21.15.55:0/3290611838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3714004800 0x7f37280ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 >> 172.21.15.55:0/3290611838 conn(0x7f37280b4b40 msgr2=0x7f372809bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 shutdown_connections 2024-05-10T03:54:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:35.933+0000 7f372cdf0640 1 -- 172.21.15.55:0/3290611838 wait complete. 2024-05-10T03:54:35.947 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_flush.TestFlush) ... FAIL 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:FAIL: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks/cephfs/test_flush.py", line 51, in test_flush 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: self.assertEqual(summary_output, 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:AssertionError: 'Events by type:\n SUBTREEMAP: 1\n UPDATE: 1\nErrors: 0' != 'Events by type:\n SUBTREEMAP: 1\nErrors: 0' 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: Events by type: 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: SUBTREEMAP: 1 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:- UPDATE: 1 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: Errors: 0 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.948 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks/cephfs/test_flush.py", line 78, in test_flush 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: self.assertEqual(self.fs.journal_tool(["event", "get", "summary"], 0), 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:AssertionError: 'Events by type:\n SUBTREEMAP: 1\n UPDATE: 1\nErrors: 0' != 'Events by type:\n SUBTREEMAP: 1\nErrors: 0' 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: Events by type: 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: SUBTREEMAP: 1 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:- UPDATE: 1 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: Errors: 0 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:Ran 1 test in 33.628s 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.949 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:FAIL: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks/cephfs/test_flush.py", line 51, in test_flush 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: self.assertEqual(summary_output, 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:AssertionError: 'Events by type:\n SUBTREEMAP: 1\n UPDATE: 1\nErrors: 0' != 'Events by type:\n SUBTREEMAP: 1\nErrors: 0' 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: Events by type: 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: SUBTREEMAP: 1 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:- UPDATE: 1 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: Errors: 0 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks/cephfs/test_flush.py", line 78, in test_flush 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner: self.assertEqual(self.fs.journal_tool(["event", "get", "summary"], 0), 2024-05-10T03:54:35.950 INFO:tasks.cephfs_test_runner:AssertionError: 'Events by type:\n SUBTREEMAP: 1\n UPDATE: 1\nErrors: 0' != 'Events by type:\n SUBTREEMAP: 1\nErrors: 0' 2024-05-10T03:54:35.951 INFO:tasks.cephfs_test_runner: Events by type: 2024-05-10T03:54:35.951 INFO:tasks.cephfs_test_runner: SUBTREEMAP: 1 2024-05-10T03:54:35.951 INFO:tasks.cephfs_test_runner:- UPDATE: 1 2024-05-10T03:54:35.951 INFO:tasks.cephfs_test_runner: Errors: 0 2024-05-10T03:54:35.951 INFO:tasks.cephfs_test_runner: 2024-05-10T03:54:35.951 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-10T03:54:36.183 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=984f2e041f6742588dfcb3a74dd875ea Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_joscollin_ceph_1ef17e831a1b0a2132aa514927b7748adaf73171/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-05-10T03:54:36.184 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-10T03:54:36.193 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T03:54:36.230 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T03:54:36.231 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:36.231 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:36.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=440 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T03:54:36.252 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-10T03:54:36.252 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:36.311 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057102,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=440 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-10T03:54:36.312 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:36.312 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:36.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2620 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T03:54:36.332 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-05-10T03:54:36.333 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T03:54:36.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2620 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-10T03:54:36.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.393 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:54:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T03:54:36.411 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T03:54:36.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T03:54:36.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.479 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T03:54:36.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-05-10T03:54:36.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.644 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-10T03:54:36.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-05-10T03:54:36.731 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-05-10T03:54:36.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:54:36.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.733 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-05-10T03:54:36.753 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-10T03:54:36.753 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T03:54:36.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T03:54:36.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.825 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T03:54:36.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.895 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-05-10T03:54:36.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:36.994 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2024-05-10T03:54:37.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T03:54:37.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2024-05-10T03:54:37.082 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2024-05-10T03:54:37.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:54:37.084 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T03:54:37.093 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T03:54:37.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:54:37.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.198+0000 7f2c39111640 1 Processor -- start 2024-05-10T03:54:37.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.198+0000 7f2c39111640 1 -- start start 2024-05-10T03:54:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c39111640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2c3413f0b0 0x7f2c3413f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c39111640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c3415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c39111640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c3415d0c0 con 0x7f2c3415cb10 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c39111640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2c3413f490 con 0x7f2c3413f0b0 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c39111640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2c340cffa0 con 0x7f2c3413fc80 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2c3415cb10 0x7f2c340d0430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44132/0 (socket says 172.21.15.55:44132) 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3359e640 1 -- 172.21.15.55:0/49937333 learned_addr learned my addr 172.21.15.55:0/49937333 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c2bfff640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c3415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/49937333 >> v2:172.21.15.64:3300/0 conn(0x7f2c3413f0b0 0x7f2c3413f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045433760 0 0) 0x7f2c3415d0c0 con 0x7f2c3415cb10 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c20003520 con 0x7f2c3415cb10 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3206192235 0 0) 0x7f2c20003520 con 0x7f2c3415cb10 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 msgr2=0x7f2c3415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c3415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 >> v2:172.21.15.64:3300/0 conn(0x7f2c3413f0b0 msgr2=0x7f2c3413f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 --2- 172.21.15.55:0/49937333 >> v2:172.21.15.64:3300/0 conn(0x7f2c3413f0b0 0x7f2c3413f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3415d3a0 con 0x7f2c3415cb10 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f2c2c001a70 con 0x7f2c3415cb10 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/49937333 >> v2:172.21.15.64:3300/0 conn(0x7f2c3413f0b0 0x7f2c3413f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c2bfff640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c3415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 >> v1:172.21.15.55:6789/0 conn(0x7f2c3415cb10 legacy=0x7f2c340d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c20003a50 0x7f2c20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.199+0000 7f2c3259c640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3259c640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c20004d40 0x7f2c200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3413f490 con 0x7f2c20004d40 2024-05-10T03:54:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340cffa0 con 0x7f2c20003a50 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2000b9f0 con 0x7f2c3413fc80 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3359e640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c20004d40 0x7f2c200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c20003a50 0x7f2c20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c2bfff640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3359e640 1 -- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 msgr2=0x7f2c20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3359e640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c3413fc80 0x7f2c20004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3359e640 1 -- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c20003a50 msgr2=0x7f2c20003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3359e640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c20003a50 0x7f2c20003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.200+0000 7f2c3359e640 1 -- 172.21.15.55:0/49937333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c20003520 con 0x7f2c20004d40 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c3359e640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c20004d40 0x7f2c200051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00a850 tx=0x7f2c20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730b488d87651fa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00a4a0 con 0x7f2c20004d40 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c02f070 con 0x7f2c20004d40 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c3259c640 1 -- 172.21.15.55:0/49937333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c02bc30 con 0x7f2c20004d40 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c39111640 1 -- 172.21.15.55:0/49937333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c20004d40 msgr2=0x7f2c200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c39111640 1 --2- 172.21.15.55:0/49937333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c20004d40 0x7f2c200051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00a850 tx=0x7f2c20005830 comp rx=0 tx=0).stop 2024-05-10T03:54:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c3359e640 1 -- 172.21.15.55:0/49937333 reap_dead start 2024-05-10T03:54:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c39111640 1 -- 172.21.15.55:0/49937333 shutdown_connections 2024-05-10T03:54:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c39111640 1 -- 172.21.15.55:0/49937333 >> 172.21.15.55:0/49937333 conn(0x7f2c340b2cc0 msgr2=0x7f2c340b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c39111640 1 -- 172.21.15.55:0/49937333 shutdown_connections 2024-05-10T03:54:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.201+0000 7f2c39111640 1 -- 172.21.15.55:0/49937333 wait complete. 2024-05-10T03:54:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.203+0000 7f2c39111640 1 Processor -- start 2024-05-10T03:54:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.203+0000 7f2c39111640 1 -- start start 2024-05-10T03:54:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c39111640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c20004d40 0x7f2c34132410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c39111640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c34134b00 0x7f2c341f9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c39111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 0x7f2c3415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c39111640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340727b0 con 0x7f2c341f4ef0 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c39111640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340cf920 con 0x7f2c34134b00 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c39111640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2c340d0b40 con 0x7f2c20004d40 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 0x7f2c3415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 0x7f2c3415b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37830/0 (socket says 172.21.15.55:37830) 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 -- 172.21.15.55:0/3941535187 learned_addr learned my addr 172.21.15.55:0/3941535187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c20004d40 0x7f2c34132410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c2bfff640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c34134b00 0x7f2c341f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 -- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c20004d40 msgr2=0x7f2c34132410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c20004d40 0x7f2c34132410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 -- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c34134b00 msgr2=0x7f2c341f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c34134b00 0x7f2c341f9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 -- 172.21.15.55:0/3941535187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c34132950 con 0x7f2c341f4ef0 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c20004d40 0x7f2c34132410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.204+0000 7f2c3359e640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 0x7f2c3415b080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c02b480 tx=0x7f2c340b07a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.205+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c044070 con 0x7f2c341f4ef0 2024-05-10T03:54:37.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.205+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00a480 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.205+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c341f9ba0 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.205+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c001fe0 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.205+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3414fc60 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.205+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c34050820 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.206+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c2c047070 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.207+0000 7f2c2b7fe640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2c140762d0 0x7f2c14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.207+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f2c2c0b7200 con 0x7f2c341f4ef0 2024-05-10T03:54:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.207+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2c140762d0 0x7f2c14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.207+0000 7f2c32d9d640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2c140762d0 0x7f2c14078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009d50 tx=0x7f2c24009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.211+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c341f9ba0 con 0x7f2c341f4ef0 2024-05-10T03:54:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.397+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c3414f730 con 0x7f2c140762d0 2024-05-10T03:54:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.398+0000 7f2c2b7fe640 1 -- 172.21.15.55:0/3941535187 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13451 (secure 0 0 0) 0x7f2c3414f730 con 0x7f2c140762d0 2024-05-10T03:54:37.401 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:54:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2c140762d0 msgr2=0x7f2c14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2c140762d0 0x7f2c14078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c24009d50 tx=0x7f2c24009190 comp rx=0 tx=0).stop 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 msgr2=0x7f2c3415b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 0x7f2c3415b080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c02b480 tx=0x7f2c340b07a0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 shutdown_connections 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2c140762d0 0x7f2c14078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c341f4ef0 0x7f2c3415b080 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c34134b00 0x7f2c341f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 --2- 172.21.15.55:0/3941535187 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c20004d40 0x7f2c34132410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 >> 172.21.15.55:0/3941535187 conn(0x7f2c340b2cc0 msgr2=0x7f2c3415d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 shutdown_connections 2024-05-10T03:54:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.400+0000 7f2c39111640 1 -- 172.21.15.55:0/3941535187 wait complete. 2024-05-10T03:54:37.414 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-10T03:54:35.792236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236864,"kb_used_data":4064,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737856,"statfs":{"total":773094113280,"available":772851564544,"internally_reserved":0,"allocated":4161536,"data_stored":2328848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12742,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.908310"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-10T03:54:29.210542+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:54:29.210542+0000","last_peered":"2024-05-10T03:54:29.210542+0000","last_clean":"2024-05-10T03:54:29.210542+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:29.210542+0000","last_undegraded":"2024-05-10T03:54:29.210542+0000","last_fullsized":"2024-05-10T03:54:29.210542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":730279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":153817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":139891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":153817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":730189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:54:37.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:54:37.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.516+0000 7fcbe6ac8640 1 Processor -- start 2024-05-10T03:54:37.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.516+0000 7fcbe6ac8640 1 -- start start 2024-05-10T03:54:37.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbe6ac8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbe0163cb0 0x7fcbe00d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbe6ac8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcbe015f770 0x7fcbe015fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbe6ac8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe009bcb0 con 0x7fcbe0163080 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbe6ac8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe009ba60 con 0x7fcbe0163cb0 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbe6ac8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe009bf90 con 0x7fcbe015f770 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbe0163cb0 0x7fcbe00d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbe0163cb0 0x7fcbe00d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37844/0 (socket says 172.21.15.55:37844) 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 -- 172.21.15.55:0/1174984373 learned_addr learned my addr 172.21.15.55:0/1174984373 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:37.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbe5065640 1 --2- 172.21.15.55:0/1174984373 >> v2:172.21.15.64:3300/0 conn(0x7fcbe015f770 0x7fcbe015fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 -- 172.21.15.55:0/1174984373 >> v2:172.21.15.64:3300/0 conn(0x7fcbe015f770 msgr2=0x7fcbe015fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 --2- 172.21.15.55:0/1174984373 >> v2:172.21.15.64:3300/0 conn(0x7fcbe015f770 0x7fcbe015fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 -- 172.21.15.55:0/1174984373 >> v1:172.21.15.64:6789/0 conn(0x7fcbe0163080 legacy=0x7fcbe0163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.517+0000 7fcbdffff640 1 -- 172.21.15.55:0/1174984373 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe009c270 con 0x7fcbe0163cb0 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.518+0000 7fcbdffff640 1 --2- 172.21.15.55:0/1174984373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00d1d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00d2990 tx=0x7fcbcc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12284f13e0579bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.518+0000 7fcbdf7fe640 1 -- 172.21.15.55:0/1174984373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc037070 con 0x7fcbe0163cb0 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.518+0000 7fcbdf7fe640 1 -- 172.21.15.55:0/1174984373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc02ae50 con 0x7fcbe0163cb0 2024-05-10T03:54:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.518+0000 7fcbdf7fe640 1 -- 172.21.15.55:0/1174984373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc032860 con 0x7fcbe0163cb0 2024-05-10T03:54:37.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/1174984373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163cb0 msgr2=0x7fcbe00d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/1174984373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00d1d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00d2990 tx=0x7fcbcc02a300 comp rx=0 tx=0).stop 2024-05-10T03:54:37.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/1174984373 shutdown_connections 2024-05-10T03:54:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/1174984373 >> v2:172.21.15.64:3300/0 conn(0x7fcbe015f770 0x7fcbe015fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/1174984373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00d1d10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/1174984373 >> 172.21.15.55:0/1174984373 conn(0x7fcbe00b4d70 msgr2=0x7fcbe00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/1174984373 shutdown_connections 2024-05-10T03:54:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.519+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/1174984373 wait complete. 2024-05-10T03:54:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.520+0000 7fcbe6ac8640 1 Processor -- start 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.520+0000 7fcbe6ac8640 1 -- start start 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe6ac8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcbe015f770 0x7fcbe0160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe6ac8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 0x7fcbe00b8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe6ac8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe6ac8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d2250 con 0x7fcbe0163080 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe6ac8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe009c830 con 0x7fcbe0163cb0 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe6ac8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00cef80 con 0x7fcbe015f770 2024-05-10T03:54:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 0x7fcbe00b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 0x7fcbe00b8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37860/0 (socket says 172.21.15.55:37860) 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 -- 172.21.15.55:0/335693767 learned_addr learned my addr 172.21.15.55:0/335693767 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe4864640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcbe015f770 0x7fcbe0160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbe5065640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 -- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcbe015f770 msgr2=0x7fcbe0160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcbe015f770 0x7fcbe0160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 -- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbe0163cb0 msgr2=0x7fcbe00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 -- 172.21.15.55:0/335693767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe015cde0 con 0x7fcbe0163080 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.521+0000 7fcbdffff640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 0x7fcbe00b8440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc02a340 tx=0x7fcbcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.522+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc041070 con 0x7fcbe0163080 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.522+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbcc03c680 con 0x7fcbe0163080 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.522+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe0161450 con 0x7fcbe0163080 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.522+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc037040 con 0x7fcbe0163080 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.522+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01f5ef0 con 0x7fcbe0163080 2024-05-10T03:54:37.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.523+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe00a1390 con 0x7fcbe0163080 2024-05-10T03:54:37.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.523+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcbcc044070 con 0x7fcbe0163080 2024-05-10T03:54:37.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.524+0000 7fcbdd7fa640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcbc4076300 0x7fcbc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.524+0000 7fcbe4864640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcbc4076300 0x7fcbc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.524+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fcbcc0b7920 con 0x7fcbe0163080 2024-05-10T03:54:37.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.524+0000 7fcbe4864640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcbc4076300 0x7fcbc40787c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40017c0 tx=0x7fcbd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.528+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcbcc080fc0 con 0x7fcbe0163080 2024-05-10T03:54:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.715+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbe00696a0 con 0x7fcbc4076300 2024-05-10T03:54:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.715+0000 7fcbdd7fa640 1 -- 172.21.15.55:0/335693767 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13451 (secure 0 0 0) 0x7fcbe00696a0 con 0x7fcbc4076300 2024-05-10T03:54:37.718 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:54:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcbc4076300 msgr2=0x7fcbc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcbc4076300 0x7fcbc40787c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40017c0 tx=0x7fcbd4009040 comp rx=0 tx=0).stop 2024-05-10T03:54:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 msgr2=0x7fcbe00b8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 0x7fcbe00b8440 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc02a340 tx=0x7fcbcc0046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 shutdown_connections 2024-05-10T03:54:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcbe0163cb0 0x7fcbe00cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fcbc4076300 0x7fcbc40787c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe0163080 0x7fcbe00b8440 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 --2- 172.21.15.55:0/335693767 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcbe015f770 0x7fcbe0160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 >> 172.21.15.55:0/335693767 conn(0x7fcbe00b4d70 msgr2=0x7fcbe0163460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 shutdown_connections 2024-05-10T03:54:37.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.718+0000 7fcbe6ac8640 1 -- 172.21.15.55:0/335693767 wait complete. 2024-05-10T03:54:37.732 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-05-10T03:54:35.792236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236864,"kb_used_data":4064,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737856,"statfs":{"total":773094113280,"available":772851564544,"internally_reserved":0,"allocated":4161536,"data_stored":2328848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12742,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.908310"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-10T03:54:29.210542+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:54:29.210542+0000","last_peered":"2024-05-10T03:54:29.210542+0000","last_clean":"2024-05-10T03:54:29.210542+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:29.210542+0000","last_undegraded":"2024-05-10T03:54:29.210542+0000","last_fullsized":"2024-05-10T03:54:29.210542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":730279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":153817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":139891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":153817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":730189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:54:37.732 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T03:54:37.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:54:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.834+0000 7f2d9e532640 1 Processor -- start 2024-05-10T03:54:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.834+0000 7f2d9e532640 1 -- start start 2024-05-10T03:54:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9e532640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2d98073ba0 0x7f2d98074210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9e532640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d9815d670 con 0x7f2d9815d290 2024-05-10T03:54:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9e532640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980b3980 con 0x7f2d980b69e0 2024-05-10T03:54:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9e532640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980cdb20 con 0x7f2d98073ba0 2024-05-10T03:54:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d97fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2d9815d290 0x7f2d980b62d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44138/0 (socket says 172.21.15.55:44138) 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d97fff640 1 -- 172.21.15.55:0/3800334507 learned_addr learned my addr 172.21.15.55:0/3800334507 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9cacf640 1 --2- 172.21.15.55:0/3800334507 >> v2:172.21.15.64:3300/0 conn(0x7f2d98073ba0 0x7f2d98074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d96ffd640 1 -- 172.21.15.55:0/3800334507 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433650039 0 0) 0x7f2d9815d670 con 0x7f2d9815d290 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d96ffd640 1 -- 172.21.15.55:0/3800334507 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d80003520 con 0x7f2d9815d290 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9cacf640 1 -- 172.21.15.55:0/3800334507 >> v1:172.21.15.64:6789/0 conn(0x7f2d980b69e0 legacy=0x7f2d9815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d9cacf640 1 -- 172.21.15.55:0/3800334507 >> v1:172.21.15.55:6789/0 conn(0x7f2d9815d290 legacy=0x7f2d980b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.835+0000 7f2d96ffd640 1 -- 172.21.15.55:0/3800334507 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118343384 0 0) 0x7f2d980b3980 con 0x7f2d980b69e0 2024-05-10T03:54:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.836+0000 7f2d9cacf640 1 -- 172.21.15.55:0/3800334507 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980cde00 con 0x7f2d98073ba0 2024-05-10T03:54:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.836+0000 7f2d9cacf640 1 --2- 172.21.15.55:0/3800334507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d98073ba0 0x7f2d98074210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009d90 tx=0x7f2d9002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879dc56fefa5b907 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.836+0000 7f2d96ffd640 1 -- 172.21.15.55:0/3800334507 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90007740 con 0x7f2d98073ba0 2024-05-10T03:54:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.836+0000 7f2d96ffd640 1 -- 172.21.15.55:0/3800334507 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d900078e0 con 0x7f2d98073ba0 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.836+0000 7f2d96ffd640 1 -- 172.21.15.55:0/3800334507 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90007c90 con 0x7f2d98073ba0 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 -- 172.21.15.55:0/3800334507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d98073ba0 msgr2=0x7f2d98074210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 --2- 172.21.15.55:0/3800334507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d98073ba0 0x7f2d98074210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009d90 tx=0x7f2d9002a660 comp rx=0 tx=0).stop 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 -- 172.21.15.55:0/3800334507 shutdown_connections 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 --2- 172.21.15.55:0/3800334507 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d98073ba0 0x7f2d98074210 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 -- 172.21.15.55:0/3800334507 >> 172.21.15.55:0/3800334507 conn(0x7f2d980b2cc0 msgr2=0x7f2d980b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 -- 172.21.15.55:0/3800334507 shutdown_connections 2024-05-10T03:54:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.837+0000 7f2d9e532640 1 -- 172.21.15.55:0/3800334507 wait complete. 2024-05-10T03:54:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.838+0000 7f2d9e532640 1 Processor -- start 2024-05-10T03:54:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.838+0000 7f2d9e532640 1 -- start start 2024-05-10T03:54:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d9e532640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d98073ba0 0x7f2d981f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d9e532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 0x7f2d981f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d9e532640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d9815d290 0x7f2d981f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d9e532640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9815e390 con 0x7f2d980b69e0 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d9e532640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9815e210 con 0x7f2d9815d290 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d9e532640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2d9815e510 con 0x7f2d98073ba0 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 0x7f2d981f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 0x7f2d981f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37866/0 (socket says 172.21.15.55:37866) 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.839+0000 7f2d977fe640 1 -- 172.21.15.55:0/69070051 learned_addr learned my addr 172.21.15.55:0/69070051 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d977fe640 1 -- 172.21.15.55:0/69070051 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d98073ba0 msgr2=0x7f2d981f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d977fe640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d98073ba0 0x7f2d981f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d977fe640 1 -- 172.21.15.55:0/69070051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d9815d290 msgr2=0x7f2d981f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d977fe640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d9815d290 0x7f2d981f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d977fe640 1 -- 172.21.15.55:0/69070051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d98159f50 con 0x7f2d980b69e0 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d977fe640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 0x7f2d981f5f30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c530 tx=0x7f2d8c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c017070 con 0x7f2d980b69e0 2024-05-10T03:54:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0035f0 con 0x7f2d980b69e0 2024-05-10T03:54:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d98142730 con 0x7f2d980b69e0 2024-05-10T03:54:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0039e0 con 0x7f2d980b69e0 2024-05-10T03:54:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.840+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d98142cf0 con 0x7f2d980b69e0 2024-05-10T03:54:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.841+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d9806f450 con 0x7f2d980b69e0 2024-05-10T03:54:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.842+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d8c01a070 con 0x7f2d980b69e0 2024-05-10T03:54:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.842+0000 7f2d94ff9640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2d840762d0 0x7f2d84078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.843+0000 7f2d97fff640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2d840762d0 0x7f2d84078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.843+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f2d8c096680 con 0x7f2d980b69e0 2024-05-10T03:54:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.843+0000 7f2d97fff640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2d840762d0 0x7f2d84078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d88001220 tx=0x7f2d880078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:37.847+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d8c060370 con 0x7f2d980b69e0 2024-05-10T03:54:38.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.037+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d98050820 con 0x7f2d840762d0 2024-05-10T03:54:38.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.038+0000 7f2d94ff9640 1 -- 172.21.15.55:0/69070051 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13451 (secure 0 0 0) 0x7f2d98050820 con 0x7f2d840762d0 2024-05-10T03:54:38.041 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:38.041 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:54:38.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.039+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2d840762d0 msgr2=0x7f2d84078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.039+0000 7f2d9e532640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2d840762d0 0x7f2d84078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d88001220 tx=0x7f2d880078f0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 msgr2=0x7f2d981f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 0x7f2d981f5f30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c530 tx=0x7f2d8c00c9f0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 shutdown_connections 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d9815d290 0x7f2d981f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2d840762d0 0x7f2d84078790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d980b69e0 0x7f2d981f5f30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 --2- 172.21.15.55:0/69070051 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d98073ba0 0x7f2d981f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 >> 172.21.15.55:0/69070051 conn(0x7f2d980b2cc0 msgr2=0x7f2d980721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:38.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 shutdown_connections 2024-05-10T03:54:38.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.040+0000 7f2d9e532640 1 -- 172.21.15.55:0/69070051 wait complete. 2024-05-10T03:54:38.053 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-05-10T03:54:37.792543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236864,"kb_used_data":4064,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737856,"statfs":{"total":773094113280,"available":772851564544,"internally_reserved":0,"allocated":4161536,"data_stored":2328848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12742,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-55,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001832"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-10T03:54:29.210542+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:54:29.210542+0000","last_peered":"2024-05-10T03:54:29.210542+0000","last_clean":"2024-05-10T03:54:29.210542+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:29.210542+0000","last_undegraded":"2024-05-10T03:54:29.210542+0000","last_fullsized":"2024-05-10T03:54:29.210542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":730279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":153817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":139891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":389120,"data_stored":153817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":730189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:54:38.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T03:54:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.155+0000 7f72d6ec8640 1 Processor -- start 2024-05-10T03:54:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.156+0000 7f72d6ec8640 1 -- start start 2024-05-10T03:54:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.156+0000 7f72d6ec8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72d015f700 0x7f72d00d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.156+0000 7f72d6ec8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d00d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.156+0000 7f72d6ec8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d00d6250 con 0x7f72d00d1cc0 2024-05-10T03:54:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.156+0000 7f72d6ec8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f72d015fae0 con 0x7f72d015f700 2024-05-10T03:54:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.156+0000 7f72d6ec8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00d1380 con 0x7f72d0160670 2024-05-10T03:54:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72d015f700 0x7f72d00d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72cffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d00d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72d015f700 0x7f72d00d5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:45038/0 (socket says 172.21.15.55:45038) 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72cffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d00d0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:46678/0 (socket says 172.21.15.55:46678) 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d5465640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f72d00d1cc0 0x7f72d00d2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49020/0 (socket says 172.21.15.55:49020) 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 -- 172.21.15.55:0/259706060 learned_addr learned my addr 172.21.15.55:0/259706060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 -- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 msgr2=0x7f72d00d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 --2- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d00d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 -- 172.21.15.55:0/259706060 >> v1:172.21.15.64:6789/0 conn(0x7f72d00d1cc0 legacy=0x7f72d00d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72d4c64640 1 -- 172.21.15.55:0/259706060 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d00d0080 con 0x7f72d015f700 2024-05-10T03:54:38.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.157+0000 7f72cffff640 1 --2- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d00d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.158+0000 7f72d4c64640 1 --2- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00d5c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8b9d8137f4e4167 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.158+0000 7f72cf7fe640 1 -- 172.21.15.55:0/259706060 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0037070 con 0x7f72d015f700 2024-05-10T03:54:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.158+0000 7f72cf7fe640 1 -- 172.21.15.55:0/259706060 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c0032440 con 0x7f72d015f700 2024-05-10T03:54:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.158+0000 7f72cf7fe640 1 -- 172.21.15.55:0/259706060 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0032810 con 0x7f72d015f700 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 -- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 msgr2=0x7f72d00d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00d5c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009870 tx=0x7f72c002a270 comp rx=0 tx=0).stop 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 -- 172.21.15.55:0/259706060 shutdown_connections 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d00d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/259706060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00d5c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 -- 172.21.15.55:0/259706060 >> 172.21.15.55:0/259706060 conn(0x7f72d009e5d0 msgr2=0x7f72d00d52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 -- 172.21.15.55:0/259706060 shutdown_connections 2024-05-10T03:54:38.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.159+0000 7f72d6ec8640 1 -- 172.21.15.55:0/259706060 wait complete. 2024-05-10T03:54:38.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.160+0000 7f72d6ec8640 1 Processor -- start 2024-05-10T03:54:38.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.160+0000 7f72d6ec8640 1 -- start start 2024-05-10T03:54:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d6ec8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 0x7f72d014f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d6ec8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d6ec8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d6ec8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00d0920 con 0x7f72d00d1cc0 2024-05-10T03:54:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d6ec8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00d0640 con 0x7f72d015f700 2024-05-10T03:54:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d6ec8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f72d0160ab0 con 0x7f72d0160670 2024-05-10T03:54:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 0x7f72d014f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 0x7f72d014f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37870/0 (socket says 172.21.15.55:37870) 2024-05-10T03:54:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 -- 172.21.15.55:0/3454594019 learned_addr learned my addr 172.21.15.55:0/3454594019 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72cffff640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d5465640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 -- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 msgr2=0x7f72d0151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d0151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 -- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 msgr2=0x7f72d00cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.161+0000 7f72d4c64640 1 -- 172.21.15.55:0/3454594019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d00ca540 con 0x7f72d00d1cc0 2024-05-10T03:54:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.162+0000 7f72d4c64640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 0x7f72d014f0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f72c0000c00 tx=0x7f72c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.162+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0037040 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.162+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c0042070 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.162+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d00ca7e0 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.162+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0030880 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.162+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d00b4cc0 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.163+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d00a3240 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.164+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f72c0030a20 con 0x7f72d00d1cc0 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.164+0000 7f72cd7fa640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72bc0762d0 0x7f72bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:38.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.164+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f72c00b7a70 con 0x7f72d00d1cc0 2024-05-10T03:54:38.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.164+0000 7f72cffff640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72bc0762d0 0x7f72bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:38.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.165+0000 7f72cffff640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72bc0762d0 0x7f72bc078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009560 tx=0x7f72c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:38.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.169+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f72c0081080 con 0x7f72d00d1cc0 2024-05-10T03:54:38.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.361+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72d00d5a00 con 0x7f72d00d1cc0 2024-05-10T03:54:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.362+0000 7f72cd7fa640 1 -- 172.21.15.55:0/3454594019 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+12924 (secure 0 0 0) 0x7f72c0085380 con 0x7f72d00d1cc0 2024-05-10T03:54:38.365 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:38.365 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"799093e3-fb07-47b3-97e4-8d13003c3bca","created":"2024-05-10T03:53:21.316619+0000","modified":"2024-05-10T03:54:34.921513+0000","last_up_change":"2024-05-10T03:53:31.881041+0000","last_in_change":"2024-05-10T03:53:23.558328+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T03:53:33.798554+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9629c521-758a-4133-a133-430db518f8c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6825","nonce":2785073931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6827","nonce":2785073931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6831","nonce":2785073931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":2785073931},{"type":"v1","addr":"172.21.15.55:6829","nonce":2785073931}]},"public_addr":"172.21.15.55:6825/2785073931","cluster_addr":"172.21.15.55:6827/2785073931","heartbeat_back_addr":"172.21.15.55:6831/2785073931","heartbeat_front_addr":"172.21.15.55:6829/2785073931","state":["exists","up"]},{"osd":1,"uuid":"860c3a27-ab92-46c3-a14f-0cf3be4bf236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6815","nonce":141982067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6819","nonce":141982067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6823","nonce":141982067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":141982067},{"type":"v1","addr":"172.21.15.55:6821","nonce":141982067}]},"public_addr":"172.21.15.55:6815/141982067","cluster_addr":"172.21.15.55:6819/141982067","heartbeat_back_addr":"172.21.15.55:6823/141982067","heartbeat_front_addr":"172.21.15.55:6821/141982067","state":["exists","up"]},{"osd":2,"uuid":"30621317-d378-4372-93d6-04a972bf4652","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6801","nonce":3097925138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6803","nonce":3097925138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6807","nonce":3097925138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":3097925138},{"type":"v1","addr":"172.21.15.55:6805","nonce":3097925138}]},"public_addr":"172.21.15.55:6801/3097925138","cluster_addr":"172.21.15.55:6803/3097925138","heartbeat_back_addr":"172.21.15.55:6807/3097925138","heartbeat_front_addr":"172.21.15.55:6805/3097925138","state":["exists","up"]},{"osd":3,"uuid":"af0dd4b2-b7a1-4d5d-b201-df349eae9b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6809","nonce":600411321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6811","nonce":600411321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6818","nonce":600411321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":600411321},{"type":"v1","addr":"172.21.15.55:6814","nonce":600411321}]},"public_addr":"172.21.15.55:6809/600411321","cluster_addr":"172.21.15.55:6811/600411321","heartbeat_back_addr":"172.21.15.55:6818/600411321","heartbeat_front_addr":"172.21.15.55:6814/600411321","state":["exists","up"]},{"osd":4,"uuid":"2d657b0f-cf76-48fa-8aa1-430fe9f8bee6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6809","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6811","nonce":945910103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6813","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6815","nonce":945910103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6823","nonce":945910103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":945910103},{"type":"v1","addr":"172.21.15.64:6820","nonce":945910103}]},"public_addr":"172.21.15.64:6811/945910103","cluster_addr":"172.21.15.64:6815/945910103","heartbeat_back_addr":"172.21.15.64:6823/945910103","heartbeat_front_addr":"172.21.15.64:6820/945910103","state":["exists","up"]},{"osd":5,"uuid":"5a8ebcdc-bbfd-46a5-b7bb-ccf06ed56374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6810","nonce":3692026818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6814","nonce":3692026818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6819","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6821","nonce":3692026818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3692026818},{"type":"v1","addr":"172.21.15.64:6817","nonce":3692026818}]},"public_addr":"172.21.15.64:6810/3692026818","cluster_addr":"172.21.15.64:6814/3692026818","heartbeat_back_addr":"172.21.15.64:6821/3692026818","heartbeat_front_addr":"172.21.15.64:6817/3692026818","state":["exists","up"]},{"osd":6,"uuid":"6eec2823-c193-4222-947f-e73ba05c73ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6825","nonce":630497291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6827","nonce":630497291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6831","nonce":630497291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":630497291},{"type":"v1","addr":"172.21.15.64:6829","nonce":630497291}]},"public_addr":"172.21.15.64:6825/630497291","cluster_addr":"172.21.15.64:6827/630497291","heartbeat_back_addr":"172.21.15.64:6831/630497291","heartbeat_front_addr":"172.21.15.64:6829/630497291","state":["exists","up"]},{"osd":7,"uuid":"a46cc402-82d1-408b-9db1-204435003db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6801","nonce":767106247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6803","nonce":767106247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6807","nonce":767106247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":767106247},{"type":"v1","addr":"172.21.15.64:6805","nonce":767106247}]},"public_addr":"172.21.15.64:6801/767106247","cluster_addr":"172.21.15.64:6803/767106247","heartbeat_back_addr":"172.21.15.64:6807/767106247","heartbeat_front_addr":"172.21.15.64:6805/767106247","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.753224+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.698064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.749021+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.752948+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706249+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.706715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.779047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T03:53:28.692516+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6836/1112724499":"2024-05-11T03:54:28.881488+0000","172.21.15.55:6834/1112724499":"2024-05-11T03:54:28.881488+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T03:54:38.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72bc0762d0 msgr2=0x7f72bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72bc0762d0 0x7f72bc078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009560 tx=0x7f72c4009190 comp rx=0 tx=0).stop 2024-05-10T03:54:38.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 msgr2=0x7f72d014f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:38.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 0x7f72d014f0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f72c0000c00 tx=0x7f72c00046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 shutdown_connections 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72d0160670 0x7f72d0151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72d015f700 0x7f72d00cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f72bc0762d0 0x7f72bc078790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 --2- 172.21.15.55:0/3454594019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72d00d1cc0 0x7f72d014f0b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 >> 172.21.15.55:0/3454594019 conn(0x7f72d009e5d0 msgr2=0x7f72d00b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 shutdown_connections 2024-05-10T03:54:38.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:38.364+0000 7f72d6ec8640 1 -- 172.21.15.55:0/3454594019 wait complete. 2024-05-10T03:54:39.379 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T03:54:39.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.497+0000 7f6224825640 1 Processor -- start 2024-05-10T03:54:39.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.497+0000 7f6224825640 1 -- start start 2024-05-10T03:54:39.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f6224825640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62200d2520 0x7f62200b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f6224825640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f6224825640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622015fa60 con 0x7f62201607a0 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f6224825640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f622006f2d0 con 0x7f62200d2520 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f6224825640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f622015fce0 con 0x7f62200d2900 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f621e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62200d2520 0x7f62200b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f621dd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f62201607a0 0x7f622006e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44144/0 (socket says 172.21.15.55:44144) 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f621dd9b640 1 -- 172.21.15.55:0/2373847834 learned_addr learned my addr 172.21.15.55:0/2373847834 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.498+0000 7f621ed9d640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621e59c640 1 -- 172.21.15.55:0/2373847834 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 msgr2=0x7f622006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:39.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621e59c640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622006ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621e59c640 1 -- 172.21.15.55:0/2373847834 >> v1:172.21.15.55:6789/0 conn(0x7f62201607a0 legacy=0x7f622006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621e59c640 1 -- 172.21.15.55:0/2373847834 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622015ffc0 con 0x7f62200d2520 2024-05-10T03:54:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621d59a640 1 -- 172.21.15.55:0/2373847834 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057273205 0 0) 0x7f6214001110 con 0x7f62201607a0 2024-05-10T03:54:39.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621ed9d640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621e59c640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62200d2520 0x7f62200b5020 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62100097a0 tx=0x7f621002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac8dded47a48288 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.499+0000 7f621d59a640 1 -- 172.21.15.55:0/2373847834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210037070 con 0x7f62200d2520 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f621d59a640 1 -- 172.21.15.55:0/2373847834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210032440 con 0x7f62200d2520 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f621d59a640 1 -- 172.21.15.55:0/2373847834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210032810 con 0x7f62200d2520 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 -- 172.21.15.55:0/2373847834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62200d2520 msgr2=0x7f62200b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62200d2520 0x7f62200b5020 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62100097a0 tx=0x7f621002a180 comp rx=0 tx=0).stop 2024-05-10T03:54:39.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 -- 172.21.15.55:0/2373847834 shutdown_connections 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 --2- 172.21.15.55:0/2373847834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62200d2520 0x7f62200b5020 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 -- 172.21.15.55:0/2373847834 >> 172.21.15.55:0/2373847834 conn(0x7f622006c780 msgr2=0x7f622006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 -- 172.21.15.55:0/2373847834 shutdown_connections 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.500+0000 7f6224825640 1 -- 172.21.15.55:0/2373847834 wait complete. 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 Processor -- start 2024-05-10T03:54:39.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 -- start start 2024-05-10T03:54:39.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62200d2520 0x7f62200b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62201f5020 0x7f62201f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f62200b56e0 con 0x7f62201f5020 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f62200b5560 con 0x7f62200d2520 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.502+0000 7f6224825640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f62200b5860 con 0x7f62200d2900 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62201f5020 0x7f62201f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62201f5020 0x7f62201f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37884/0 (socket says 172.21.15.55:37884) 2024-05-10T03:54:39.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 -- 172.21.15.55:0/1971217811 learned_addr learned my addr 172.21.15.55:0/1971217811 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621dd9b640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621e59c640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62200d2520 0x7f62200b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 -- 172.21.15.55:0/1971217811 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 msgr2=0x7f622015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f62200d2900 0x7f622015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 -- 172.21.15.55:0/1971217811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62200d2520 msgr2=0x7f62200b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f62200d2520 0x7f62200b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 -- 172.21.15.55:0/1971217811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622015cf50 con 0x7f62201f5020 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f621ed9d640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62201f5020 0x7f62201f8900 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6218007ef0 tx=0x7f621800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621801a070 con 0x7f62201f5020 2024-05-10T03:54:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6218015600 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62200b6cc0 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180159f0 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.503+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62200b7280 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.504+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f622006a7e0 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.505+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f621801d070 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.505+0000 7f620effd640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f62000762d0 0x7f6200078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f62180974f0 con 0x7f62201f5020 2024-05-10T03:54:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f621e59c640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f62000762d0 0x7f6200078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f620effd640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f620007c190 0x7f620007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 --> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f620007ec60 con 0x7f620007c190 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f621809e050 con 0x7f62201f5020 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f621dd9b640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f620007c190 0x7f620007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f621e59c640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f62000762d0 0x7f6200078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.506+0000 7f621dd9b640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f620007c190 0x7f620007e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.507+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== osd.0 v2:172.21.15.55:6824/2785073931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f620007ec60 con 0x7f620007c190 2024-05-10T03:54:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.520+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 --> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f62200d0a30 con 0x7f620007c190 2024-05-10T03:54:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.520+0000 7f620effd640 1 -- 172.21.15.55:0/1971217811 <== osd.0 v2:172.21.15.55:6824/2785073931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f62200d0a30 con 0x7f620007c190 2024-05-10T03:54:39.523 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:39.523 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:39.524 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:39.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f620007c190 msgr2=0x7f620007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6824/2785073931,v1:172.21.15.55:6825/2785073931] conn(0x7f620007c190 0x7f620007e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f62000762d0 msgr2=0x7f6200078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f62000762d0 0x7f6200078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002e000 comp rx=0 tx=0).stop 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62201f5020 msgr2=0x7f62201f8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 --2- 172.21.15.55:0/1971217811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62201f5020 0x7f62201f8900 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6218007ef0 tx=0x7f621800d4a0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f621ed9d640 1 -- 172.21.15.55:0/1971217811 reap_dead start 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 shutdown_connections 2024-05-10T03:54:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 >> 172.21.15.55:0/1971217811 conn(0x7f622006c780 msgr2=0x7f62200b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:39.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 shutdown_connections 2024-05-10T03:54:39.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.521+0000 7f6224825640 1 -- 172.21.15.55:0/1971217811 wait complete. 2024-05-10T03:54:39.535 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T03:54:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.637+0000 7f9c4dae1640 1 Processor -- start 2024-05-10T03:54:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.637+0000 7f9c4dae1640 1 -- start start 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.637+0000 7f9c4dae1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f830 0x7f9c480b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.637+0000 7f9c4dae1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c480b5da0 con 0x7f9c480b5740 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.637+0000 7f9c4dae1640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c480b6080 con 0x7f9c4815f450 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.637+0000 7f9c4dae1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9c48163460 con 0x7f9c4815f830 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c47fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9c480b5740 0x7f9c480d5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44146/0 (socket says 172.21.15.55:44146) 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c47fff640 1 -- 172.21.15.55:0/2948422878 learned_addr learned my addr 172.21.15.55:0/2948422878 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c46ffd640 1 --2- 172.21.15.55:0/2948422878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f830 0x7f9c480b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764623013 0 0) 0x7f9c480b5da0 con 0x7f9c480b5740 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c30003520 con 0x7f9c480b5740 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385255905 0 0) 0x7f9c480b6080 con 0x7f9c4815f450 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c480b5da0 con 0x7f9c4815f450 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c46ffd640 1 -- 172.21.15.55:0/2948422878 >> v1:172.21.15.64:6789/0 conn(0x7f9c4815f450 legacy=0x7f9c480cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1144125928 0 0) 0x7f9c30003520 con 0x7f9c480b5740 2024-05-10T03:54:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c46ffd640 1 -- 172.21.15.55:0/2948422878 >> v1:172.21.15.55:6789/0 conn(0x7f9c480b5740 legacy=0x7f9c480d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.638+0000 7f9c46ffd640 1 -- 172.21.15.55:0/2948422878 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c480d3020 con 0x7f9c4815f830 2024-05-10T03:54:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.639+0000 7f9c46ffd640 1 --2- 172.21.15.55:0/2948422878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f830 0x7f9c480b5200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097d0 tx=0x7f9c3c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa9c1ed2d4eab531 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.639+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c037070 con 0x7f9c4815f830 2024-05-10T03:54:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.639+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c02ac30 con 0x7f9c4815f830 2024-05-10T03:54:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.639+0000 7f9c467fc640 1 -- 172.21.15.55:0/2948422878 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40001a70 con 0x7f9c4815f830 2024-05-10T03:54:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 -- 172.21.15.55:0/2948422878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f830 msgr2=0x7f9c480b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/2948422878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f830 0x7f9c480b5200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0097d0 tx=0x7f9c3c02a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 -- 172.21.15.55:0/2948422878 shutdown_connections 2024-05-10T03:54:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/2948422878 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f830 0x7f9c480b5200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 -- 172.21.15.55:0/2948422878 >> 172.21.15.55:0/2948422878 conn(0x7f9c4808ec90 msgr2=0x7f9c4809e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 -- 172.21.15.55:0/2948422878 shutdown_connections 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.640+0000 7f9c4dae1640 1 -- 172.21.15.55:0/2948422878 wait complete. 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.641+0000 7f9c4dae1640 1 Processor -- start 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.641+0000 7f9c4dae1640 1 -- start start 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c4dae1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c480b5740 0x7f9c480cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c4dae1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f450 0x7f9c48158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c4dae1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 0x7f9c48161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c4dae1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9c480d5970 con 0x7f9c4815f830 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c4dae1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9c480d0580 con 0x7f9c480b5740 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c4dae1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9c480d5af0 con 0x7f9c4815f450 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 0x7f9c48161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 0x7f9c48161cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37892/0 (socket says 172.21.15.55:37892) 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 -- 172.21.15.55:0/3099653606 learned_addr learned my addr 172.21.15.55:0/3099653606 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c477fe640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c480b5740 0x7f9c480cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c46ffd640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f450 0x7f9c48158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 -- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f450 msgr2=0x7f9c48158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f450 0x7f9c48158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 -- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c480b5740 msgr2=0x7f9c480cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c480b5740 0x7f9c480cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 -- 172.21.15.55:0/3099653606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c48158890 con 0x7f9c4815f830 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.642+0000 7f9c47fff640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 0x7f9c48161cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000cc30 tx=0x7f9c4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.643+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40017070 con 0x7f9c4815f830 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.643+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4000ce40 con 0x7f9c4815f830 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.643+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c480cf1b0 con 0x7f9c4815f830 2024-05-10T03:54:39.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.643+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40012640 con 0x7f9c4815f830 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.643+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c48160c30 con 0x7f9c4815f830 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.644+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4806a7e0 con 0x7f9c4815f830 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.644+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c4001a070 con 0x7f9c4815f830 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.645+0000 7f9c2ffff640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9c340762d0 0x7f9c34078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.645+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f9c400970c0 con 0x7f9c4815f830 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.645+0000 7f9c477fe640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9c340762d0 0x7f9c34078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.645+0000 7f9c477fe640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9c340762d0 0x7f9c34078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c38007fd0 tx=0x7f9c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.649+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c40060760 con 0x7f9c4815f830 2024-05-10T03:54:39.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.843+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9c48160790 con 0x7f9c340762d0 2024-05-10T03:54:39.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.843+0000 7f9c2ffff640 1 -- 172.21.15.55:0/3099653606 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c3800f750 con 0x7f9c340762d0 2024-05-10T03:54:39.847 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T03:54:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9c340762d0 msgr2=0x7f9c34078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9c340762d0 0x7f9c34078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c38007fd0 tx=0x7f9c38009040 comp rx=0 tx=0).stop 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 msgr2=0x7f9c48161cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 0x7f9c48161cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000cc30 tx=0x7f9c4000a430 comp rx=0 tx=0).stop 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 shutdown_connections 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f9c340762d0 0x7f9c34078790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c4815f830 0x7f9c48161cb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c4815f450 0x7f9c48158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 --2- 172.21.15.55:0/3099653606 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c480b5740 0x7f9c480cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.845+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 >> 172.21.15.55:0/3099653606 conn(0x7f9c4808ec90 msgr2=0x7f9c480d5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.846+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 shutdown_connections 2024-05-10T03:54:39.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.846+0000 7f9c4dae1640 1 -- 172.21.15.55:0/3099653606 wait complete. 2024-05-10T03:54:39.859 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T03:54:39.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.965+0000 7fa1f4114640 1 Processor -- start 2024-05-10T03:54:39.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.965+0000 7fa1f4114640 1 -- start start 2024-05-10T03:54:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f4114640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1ec0d21b0 0x7fa1ec0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f4114640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa1ec0d3ef0 0x7fa1ec15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f4114640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1ec0d2590 con 0x7fa1ec0d2fe0 2024-05-10T03:54:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f4114640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ec0d1190 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f4114640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ec0d6170 con 0x7fa1ec0d3ef0 2024-05-10T03:54:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1ec0d21b0 0x7fa1ec0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1ec0d21b0 0x7fa1ec0cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37904/0 (socket says 172.21.15.55:37904) 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/718471 learned_addr learned my addr 172.21.15.55:0/718471 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f26b1640 1 --2- 172.21.15.55:0/718471 >> v2:172.21.15.64:3300/0 conn(0x7fa1ec0d3ef0 0x7fa1ec15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/718471 >> v2:172.21.15.64:3300/0 conn(0x7fa1ec0d3ef0 msgr2=0x7fa1ec15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 --2- 172.21.15.55:0/718471 >> v2:172.21.15.64:3300/0 conn(0x7fa1ec0d3ef0 0x7fa1ec15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/718471 >> v1:172.21.15.64:6789/0 conn(0x7fa1ec0d2fe0 legacy=0x7fa1ec0d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/718471 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec0d0610 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.966+0000 7fa1f26b1640 1 --2- 172.21.15.55:0/718471 >> v2:172.21.15.64:3300/0 conn(0x7fa1ec0d3ef0 0x7fa1ec15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:39.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.967+0000 7fa1f1eb0640 1 --2- 172.21.15.55:0/718471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0cfda0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec08e670 tx=0x7fa1e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c1d2ae50d99997 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.967+0000 7fa1f0eae640 1 -- 172.21.15.55:0/718471 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8037070 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.967+0000 7fa1f0eae640 1 -- 172.21.15.55:0/718471 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e8032440 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.967+0000 7fa1f0eae640 1 -- 172.21.15.55:0/718471 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8032810 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 -- 172.21.15.55:0/718471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 msgr2=0x7fa1ec0cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 --2- 172.21.15.55:0/718471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0cfda0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec08e670 tx=0x7fa1e802a140 comp rx=0 tx=0).stop 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 -- 172.21.15.55:0/718471 shutdown_connections 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 --2- 172.21.15.55:0/718471 >> v2:172.21.15.64:3300/0 conn(0x7fa1ec0d3ef0 0x7fa1ec15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 --2- 172.21.15.55:0/718471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0cfda0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 -- 172.21.15.55:0/718471 >> 172.21.15.55:0/718471 conn(0x7fa1ec09e540 msgr2=0x7fa1ec0d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 -- 172.21.15.55:0/718471 shutdown_connections 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.968+0000 7fa1f4114640 1 -- 172.21.15.55:0/718471 wait complete. 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.969+0000 7fa1f4114640 1 Processor -- start 2024-05-10T03:54:39.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.969+0000 7fa1f4114640 1 -- start start 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f4114640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f4114640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1ec0d2fe0 0x7fa1ec14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f4114640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ec0d3ef0 0x7fa1ec14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f4114640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec0d0eb0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f4114640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec0d0bd0 con 0x7fa1ec0d3ef0 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f4114640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ec0d02e0 con 0x7fa1ec0d2fe0 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37916/0 (socket says 172.21.15.55:37916) 2024-05-10T03:54:39.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/2099832835 learned_addr learned my addr 172.21.15.55:0/2099832835 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f26b1640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ec0d3ef0 0x7fa1ec14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f16af640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1ec0d2fe0 0x7fa1ec14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1ec0d2fe0 msgr2=0x7fa1ec14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1ec0d2fe0 0x7fa1ec14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ec0d3ef0 msgr2=0x7fa1ec14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ec0d3ef0 0x7fa1ec14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 -- 172.21.15.55:0/2099832835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec0b8c40 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f26b1640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1ec0d3ef0 0x7fa1ec14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.970+0000 7fa1f1eb0640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0b5120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8000c00 tx=0x7fa1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.971+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8037040 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.971+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e8042070 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.971+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ec0cc4e0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.971+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8030bb0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.971+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ec0ccaa0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.971+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1ec0cc2d0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.972+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1e8047460 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1e27fc640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa1d00762d0 0x7fa1d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa1e80b7ed0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1f16af640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa1d00762d0 0x7fa1d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1e27fc640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7fa1d007c190 0x7fa1d007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 --> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1e803ee50 con 0x7fa1d007c190 2024-05-10T03:54:39.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa1e80ba5d0 con 0x7fa1ec0d21b0 2024-05-10T03:54:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1f26b1640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7fa1d007c190 0x7fa1d007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1f16af640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa1d00762d0 0x7fa1d0078790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec1f9a30 tx=0x7fa1dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.973+0000 7fa1f26b1640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7fa1d007c190 0x7fa1d007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:39.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.974+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== osd.1 v2:172.21.15.55:6813/141982067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1e803ee50 con 0x7fa1d007c190 2024-05-10T03:54:39.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.987+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 --> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa1ec06a7e0 con 0x7fa1d007c190 2024-05-10T03:54:39.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.987+0000 7fa1e27fc640 1 -- 172.21.15.55:0/2099832835 <== osd.1 v2:172.21.15.55:6813/141982067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa1ec06a7e0 con 0x7fa1d007c190 2024-05-10T03:54:39.990 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:39.991 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:39.991 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7fa1d007c190 msgr2=0x7fa1d007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6813/141982067,v1:172.21.15.55:6815/141982067] conn(0x7fa1d007c190 0x7fa1d007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa1d00762d0 msgr2=0x7fa1d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa1d00762d0 0x7fa1d0078790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec1f9a30 tx=0x7fa1dc009040 comp rx=0 tx=0).stop 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 msgr2=0x7fa1ec0b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 --2- 172.21.15.55:0/2099832835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1ec0d21b0 0x7fa1ec0b5120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8000c00 tx=0x7fa1e80046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:39.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f26b1640 1 -- 172.21.15.55:0/2099832835 reap_dead start 2024-05-10T03:54:39.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 shutdown_connections 2024-05-10T03:54:39.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 >> 172.21.15.55:0/2099832835 conn(0x7fa1ec09e540 msgr2=0x7fa1ec06d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:39.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 shutdown_connections 2024-05-10T03:54:39.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:39.988+0000 7fa1f4114640 1 -- 172.21.15.55:0/2099832835 wait complete. 2024-05-10T03:54:40.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T03:54:40.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.103+0000 7f5932190640 1 Processor -- start 2024-05-10T03:54:40.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.103+0000 7f5932190640 1 -- start start 2024-05-10T03:54:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f5932190640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 0x7f592c0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f5932190640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 0x7f592c072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f5932190640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592c161bd0 con 0x7f592c0b3200 2024-05-10T03:54:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f5932190640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f592c157bd0 con 0x7f592c0740d0 2024-05-10T03:54:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f5932190640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f592c160e10 con 0x7f592c1577f0 2024-05-10T03:54:40.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 0x7f592c0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 0x7f592c072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 0x7f592c0b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:46780/0 (socket says 172.21.15.55:46780) 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 0x7f592c072290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.55:45096/0 (socket says 172.21.15.55:45096) 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592affd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f592c0b3200 0x7f592c0739c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49040/0 (socket says 172.21.15.55:49040) 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 -- 172.21.15.55:0/68662698 learned_addr learned my addr 172.21.15.55:0/68662698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 -- 172.21.15.55:0/68662698 >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 msgr2=0x7f592c072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 --2- 172.21.15.55:0/68662698 >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 0x7f592c072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 -- 172.21.15.55:0/68662698 >> v1:172.21.15.64:6789/0 conn(0x7f592c0b3200 legacy=0x7f592c0739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592b7fe640 1 -- 172.21.15.55:0/68662698 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c1610f0 con 0x7f592c1577f0 2024-05-10T03:54:40.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.104+0000 7f592bfff640 1 --2- 172.21.15.55:0/68662698 >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 0x7f592c072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:40.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.105+0000 7f592b7fe640 1 --2- 172.21.15.55:0/68662698 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 0x7f592c0b2cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f591c009870 tx=0x7f591c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50ee7f97703cc1e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.105+0000 7f592a7fc640 1 -- 172.21.15.55:0/68662698 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c037070 con 0x7f592c1577f0 2024-05-10T03:54:40.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.105+0000 7f592a7fc640 1 -- 172.21.15.55:0/68662698 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c032440 con 0x7f592c1577f0 2024-05-10T03:54:40.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.105+0000 7f592a7fc640 1 -- 172.21.15.55:0/68662698 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c032810 con 0x7f592c1577f0 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 -- 172.21.15.55:0/68662698 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 msgr2=0x7f592c0b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 --2- 172.21.15.55:0/68662698 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 0x7f592c0b2cc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f591c009870 tx=0x7f591c02a270 comp rx=0 tx=0).stop 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 -- 172.21.15.55:0/68662698 shutdown_connections 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 --2- 172.21.15.55:0/68662698 >> v2:172.21.15.64:3300/0 conn(0x7f592c0740d0 0x7f592c072290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 --2- 172.21.15.55:0/68662698 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c1577f0 0x7f592c0b2cc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 -- 172.21.15.55:0/68662698 >> 172.21.15.55:0/68662698 conn(0x7f592c06fac0 msgr2=0x7f592c06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 -- 172.21.15.55:0/68662698 shutdown_connections 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.106+0000 7f5932190640 1 -- 172.21.15.55:0/68662698 wait complete. 2024-05-10T03:54:40.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.107+0000 7f5932190640 1 Processor -- start 2024-05-10T03:54:40.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.107+0000 7f5932190640 1 -- start start 2024-05-10T03:54:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f5932190640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 0x7f592c14d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f5932190640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c0b3200 0x7f592c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f5932190640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f592c1577f0 0x7f592c0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f5932190640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0727d0 con 0x7f592c0740d0 2024-05-10T03:54:40.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f5932190640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f592c1616b0 con 0x7f592c1577f0 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f5932190640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f592c072950 con 0x7f592c0b3200 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 0x7f592c14d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 0x7f592c14d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37932/0 (socket says 172.21.15.55:37932) 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f592b7fe640 1 -- 172.21.15.55:0/2769104890 learned_addr learned my addr 172.21.15.55:0/2769104890 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f592bfff640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f592c1577f0 0x7f592c0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.108+0000 7f592affd640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c0b3200 0x7f592c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f592b7fe640 1 -- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c0b3200 msgr2=0x7f592c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f592b7fe640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c0b3200 0x7f592c0c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f592b7fe640 1 -- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f592c1577f0 msgr2=0x7f592c0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f592b7fe640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f592c1577f0 0x7f592c0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f592b7fe640 1 -- 172.21.15.55:0/2769104890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c0c6880 con 0x7f592c0740d0 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f592b7fe640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 0x7f592c14d800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f591c02a2b0 tx=0x7f591c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c041030 con 0x7f592c0740d0 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c0c6b60 con 0x7f592c0740d0 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c030440 con 0x7f592c0740d0 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c037040 con 0x7f592c0740d0 2024-05-10T03:54:40.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.109+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c0c7120 con 0x7f592c0740d0 2024-05-10T03:54:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.110+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592c06a7e0 con 0x7f592c0740d0 2024-05-10T03:54:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.111+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f591c044070 con 0x7f592c0740d0 2024-05-10T03:54:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.111+0000 7f5913fff640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59180762d0 0x7f5918078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.111+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f591c0b78d0 con 0x7f592c0740d0 2024-05-10T03:54:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.111+0000 7f592affd640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59180762d0 0x7f5918078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.112+0000 7f592affd640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59180762d0 0x7f5918078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f592c073320 tx=0x7f5920000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.116+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f591c080e60 con 0x7f592c0740d0 2024-05-10T03:54:40.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.309+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f592c15c3b0 con 0x7f59180762d0 2024-05-10T03:54:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.310+0000 7f5913fff640 1 -- 172.21.15.55:0/2769104890 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f592c15c3b0 con 0x7f59180762d0 2024-05-10T03:54:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T03:54:40.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59180762d0 msgr2=0x7f5918078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59180762d0 0x7f5918078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f592c073320 tx=0x7f5920000bc0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 msgr2=0x7f592c14d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 0x7f592c14d800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f591c02a2b0 tx=0x7f591c0046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 shutdown_connections 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f592c1577f0 0x7f592c0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f592c0b3200 0x7f592c0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f59180762d0 0x7f5918078790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 --2- 172.21.15.55:0/2769104890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f592c0740d0 0x7f592c14d800 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 >> 172.21.15.55:0/2769104890 conn(0x7f592c06fac0 msgr2=0x7f592c15b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 shutdown_connections 2024-05-10T03:54:40.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.312+0000 7f5932190640 1 -- 172.21.15.55:0/2769104890 wait complete. 2024-05-10T03:54:40.326 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T03:54:40.326 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:40.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.431+0000 7fa9cac2c640 1 Processor -- start 2024-05-10T03:54:40.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.431+0000 7fa9cac2c640 1 -- start start 2024-05-10T03:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9cac2c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa9c415f990 0x7fa9c4070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9cac2c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c4070cd0 0x7fa9c40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9cac2c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c40cea80 con 0x7fa9c40716e0 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9cac2c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c4074930 con 0x7fa9c415f990 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9cac2c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40ced60 con 0x7fa9c4070cd0 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9c3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c4070cd0 0x7fa9c40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9c89c8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa9c415f990 0x7fa9c4070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9c91c9640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fa9c40716e0 0x7fa9c406c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49052/0 (socket says 172.21.15.55:49052) 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9c91c9640 1 -- 172.21.15.55:0/1776288087 learned_addr learned my addr 172.21.15.55:0/1776288087 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:40.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.432+0000 7fa9c3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c4070cd0 0x7fa9c40711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:46804/0 (socket says 172.21.15.55:46804) 2024-05-10T03:54:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.433+0000 7fa9c89c8640 1 -- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c4070cd0 msgr2=0x7fa9c40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.433+0000 7fa9c89c8640 1 --2- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c4070cd0 0x7fa9c40711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.433+0000 7fa9c89c8640 1 -- 172.21.15.55:0/1776288087 >> v1:172.21.15.64:6789/0 conn(0x7fa9c40716e0 legacy=0x7fa9c406c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.433+0000 7fa9c89c8640 1 -- 172.21.15.55:0/1776288087 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c40cf040 con 0x7fa9c415f990 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9c89c8640 1 --2- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c415f990 0x7fa9c4070790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009d90 tx=0x7fa9bc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e146686725ca9bfc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9c37fe640 1 -- 172.21.15.55:0/1776288087 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc007740 con 0x7fa9c415f990 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9c37fe640 1 -- 172.21.15.55:0/1776288087 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc0078e0 con 0x7fa9c415f990 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9c37fe640 1 -- 172.21.15.55:0/1776288087 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc007cb0 con 0x7fa9c415f990 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 -- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c415f990 msgr2=0x7fa9c4070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 --2- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c415f990 0x7fa9c4070790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009d90 tx=0x7fa9bc02a660 comp rx=0 tx=0).stop 2024-05-10T03:54:40.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 -- 172.21.15.55:0/1776288087 shutdown_connections 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 --2- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c4070cd0 0x7fa9c40711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 --2- 172.21.15.55:0/1776288087 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c415f990 0x7fa9c4070790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 -- 172.21.15.55:0/1776288087 >> 172.21.15.55:0/1776288087 conn(0x7fa9c40d1f50 msgr2=0x7fa9c40d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 -- 172.21.15.55:0/1776288087 shutdown_connections 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.434+0000 7fa9cac2c640 1 -- 172.21.15.55:0/1776288087 wait complete. 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.435+0000 7fa9cac2c640 1 Processor -- start 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 -- start start 2024-05-10T03:54:40.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c4070cd0 0x7fa9c414bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c40716e0 0x7fa9c4154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c415f990 0x7fa9c4162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40b7110 con 0x7fa9c415f990 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40cf600 con 0x7fa9c4070cd0 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.436+0000 7fa9cac2c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40b4f60 con 0x7fa9c40716e0 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c415f990 0x7fa9c4162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c415f990 0x7fa9c4162270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37944/0 (socket says 172.21.15.55:37944) 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 -- 172.21.15.55:0/3672969499 learned_addr learned my addr 172.21.15.55:0/3672969499 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:40.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c89c8640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c4070cd0 0x7fa9c414bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c3fff640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c40716e0 0x7fa9c4154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 -- 172.21.15.55:0/3672969499 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c40716e0 msgr2=0x7fa9c4154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa9c40716e0 0x7fa9c4154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 -- 172.21.15.55:0/3672969499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c4070cd0 msgr2=0x7fa9c414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa9c4070cd0 0x7fa9c414bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 -- 172.21.15.55:0/3672969499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c414c050 con 0x7fa9c415f990 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c91c9640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c415f990 0x7fa9c4162270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c3a0 tx=0x7fa9b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4017070 con 0x7fa9c415f990 2024-05-10T03:54:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4005ce0 con 0x7fa9c415f990 2024-05-10T03:54:40.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c4154ec0 con 0x7fa9c415f990 2024-05-10T03:54:40.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40072f0 con 0x7fa9c415f990 2024-05-10T03:54:40.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.437+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c4155480 con 0x7fa9c415f990 2024-05-10T03:54:40.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.438+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9c406a7e0 con 0x7fa9c415f990 2024-05-10T03:54:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.439+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa9b401a070 con 0x7fa9c415f990 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.439+0000 7fa9c17fa640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa9b00762d0 0x7fa9b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa9b4096d60 con 0x7fa9c415f990 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c89c8640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa9b00762d0 0x7fa9b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c17fa640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7fa9b007c190 0x7fa9b007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 --> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9b401dec0 con 0x7fa9b007c190 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa9b40971f0 con 0x7fa9c415f990 2024-05-10T03:54:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c3fff640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7fa9b007c190 0x7fa9b007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c89c8640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa9b00762d0 0x7fa9b0078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034000 tx=0x7fa9bc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.440+0000 7fa9c3fff640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7fa9b007c190 0x7fa9b007e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.441+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== osd.2 v2:172.21.15.55:6800/3097925138 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9b401dec0 con 0x7fa9b007c190 2024-05-10T03:54:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 --> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa9c40744a0 con 0x7fa9b007c190 2024-05-10T03:54:40.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9c17fa640 1 -- 172.21.15.55:0/3672969499 <== osd.2 v2:172.21.15.55:6800/3097925138 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa9c40744a0 con 0x7fa9b007c190 2024-05-10T03:54:40.457 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:40.457 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:40.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7fa9b007c190 msgr2=0x7fa9b007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6800/3097925138,v1:172.21.15.55:6801/3097925138] conn(0x7fa9b007c190 0x7fa9b007e5b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa9b00762d0 msgr2=0x7fa9b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fa9b00762d0 0x7fa9b0078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034000 tx=0x7fa9bc02f000 comp rx=0 tx=0).stop 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c415f990 msgr2=0x7fa9c4162270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9cac2c640 1 --2- 172.21.15.55:0/3672969499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9c415f990 0x7fa9c4162270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c3a0 tx=0x7fa9b400c860 comp rx=0 tx=0).stop 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.454+0000 7fa9c91c9640 1 -- 172.21.15.55:0/3672969499 reap_dead start 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.455+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 shutdown_connections 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.455+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 >> 172.21.15.55:0/3672969499 conn(0x7fa9c40d1f50 msgr2=0x7fa9c406c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.455+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 shutdown_connections 2024-05-10T03:54:40.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.455+0000 7fa9cac2c640 1 -- 172.21.15.55:0/3672969499 wait complete. 2024-05-10T03:54:40.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T03:54:40.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.569+0000 7f840ee7c640 1 Processor -- start 2024-05-10T03:54:40.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.569+0000 7f840ee7c640 1 -- start start 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840ee7c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84080b44c0 0x7f840809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840ee7c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f84080b5660 0x7f840809bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840ee7c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84080cd7d0 con 0x7f84080ce590 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840ee7c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f84080b48a0 con 0x7f84080b44c0 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840ee7c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f84080cdab0 con 0x7f84080b5660 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840cc18640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84080b44c0 0x7f840809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840d419640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84080ce590 0x7f84080cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44162/0 (socket says 172.21.15.55:44162) 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.570+0000 7f840d419640 1 -- 172.21.15.55:0/2149975418 learned_addr learned my addr 172.21.15.55:0/2149975418 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f8407fff640 1 --2- 172.21.15.55:0/2149975418 >> v2:172.21.15.64:3300/0 conn(0x7f84080b5660 0x7f840809bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f840cc18640 1 -- 172.21.15.55:0/2149975418 >> v2:172.21.15.64:3300/0 conn(0x7f84080b5660 msgr2=0x7f840809bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f840cc18640 1 --2- 172.21.15.55:0/2149975418 >> v2:172.21.15.64:3300/0 conn(0x7f84080b5660 0x7f840809bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f840cc18640 1 -- 172.21.15.55:0/2149975418 >> v1:172.21.15.55:6789/0 conn(0x7f84080ce590 legacy=0x7f84080cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f840cc18640 1 -- 172.21.15.55:0/2149975418 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080cdd90 con 0x7f84080b44c0 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f84077fe640 1 -- 172.21.15.55:0/2149975418 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053725086 0 0) 0x7f84080cd7d0 con 0x7f84080ce590 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f8407fff640 1 --2- 172.21.15.55:0/2149975418 >> v2:172.21.15.64:3300/0 conn(0x7f84080b5660 0x7f840809bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:40.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f840cc18640 1 --2- 172.21.15.55:0/2149975418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b44c0 0x7f840809ba60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84080736c0 tx=0x7f83f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e4132ea1c01402 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f84077fe640 1 -- 172.21.15.55:0/2149975418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8037070 con 0x7f84080b44c0 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f84077fe640 1 -- 172.21.15.55:0/2149975418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f8032440 con 0x7f84080b44c0 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.571+0000 7f84077fe640 1 -- 172.21.15.55:0/2149975418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f802ae60 con 0x7f84080b44c0 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 -- 172.21.15.55:0/2149975418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b44c0 msgr2=0x7f840809ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 --2- 172.21.15.55:0/2149975418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b44c0 0x7f840809ba60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84080736c0 tx=0x7f83f802a110 comp rx=0 tx=0).stop 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 -- 172.21.15.55:0/2149975418 shutdown_connections 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 --2- 172.21.15.55:0/2149975418 >> v2:172.21.15.64:3300/0 conn(0x7f84080b5660 0x7f840809bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 --2- 172.21.15.55:0/2149975418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b44c0 0x7f840809ba60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 -- 172.21.15.55:0/2149975418 >> 172.21.15.55:0/2149975418 conn(0x7f84080b4b40 msgr2=0x7f84080b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 -- 172.21.15.55:0/2149975418 shutdown_connections 2024-05-10T03:54:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.572+0000 7f840ee7c640 1 -- 172.21.15.55:0/2149975418 wait complete. 2024-05-10T03:54:40.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.573+0000 7f840ee7c640 1 Processor -- start 2024-05-10T03:54:40.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.573+0000 7f840ee7c640 1 -- start start 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f840ee7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84080b44c0 0x7f84080b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f840ee7c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 0x7f84080b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f840ee7c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84080ce590 0x7f840815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f840ee7c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f840806e310 con 0x7f84080b5660 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f840ee7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f840806e6b0 con 0x7f84080b44c0 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f840ee7c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f840806e490 con 0x7f84080ce590 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f8407fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 0x7f84080b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f8407fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 0x7f84080b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37976/0 (socket says 172.21.15.55:37976) 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.574+0000 7f8407fff640 1 -- 172.21.15.55:0/1875264370 learned_addr learned my addr 172.21.15.55:0/1875264370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f840d419640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84080ce590 0x7f840815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f840cc18640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84080b44c0 0x7f84080b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f8407fff640 1 -- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84080ce590 msgr2=0x7f840815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f8407fff640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84080ce590 0x7f840815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f8407fff640 1 -- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84080b44c0 msgr2=0x7f84080b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f8407fff640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84080b44c0 0x7f84080b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f8407fff640 1 -- 172.21.15.55:0/1875264370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080cb3c0 con 0x7f84080b5660 2024-05-10T03:54:40.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f8407fff640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 0x7f84080b5b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c7f0 tx=0x7f83fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc015070 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83fc007a30 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84080cb6a0 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc007e00 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.575+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84080cbc60 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.576+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f840806a7e0 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.577+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83fc018070 con 0x7f84080b5660 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.577+0000 7f84057fa640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f83f40762d0 0x7f83f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.577+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f83fc097220 con 0x7f84080b5660 2024-05-10T03:54:40.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.577+0000 7f840cc18640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f83f40762d0 0x7f83f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.578+0000 7f840cc18640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f83f40762d0 0x7f83f4078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83f8034000 tx=0x7f83f802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.582+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83fc060f10 con 0x7f84080b5660 2024-05-10T03:54:40.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.771+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f84080b6060 con 0x7f83f40762d0 2024-05-10T03:54:40.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.771+0000 7f84057fa640 1 -- 172.21.15.55:0/1875264370 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f83f8032770 con 0x7f83f40762d0 2024-05-10T03:54:40.774 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T03:54:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f83f40762d0 msgr2=0x7f83f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f83f40762d0 0x7f83f4078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83f8034000 tx=0x7f83f802e000 comp rx=0 tx=0).stop 2024-05-10T03:54:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 msgr2=0x7f84080b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 0x7f84080b5b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c7f0 tx=0x7f83fc00cbf0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 shutdown_connections 2024-05-10T03:54:40.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84080ce590 0x7f840815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f83f40762d0 0x7f83f4078790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84080b5660 0x7f84080b5b20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 --2- 172.21.15.55:0/1875264370 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84080b44c0 0x7f84080b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 >> 172.21.15.55:0/1875264370 conn(0x7f84080b4b40 msgr2=0x7f84080b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 shutdown_connections 2024-05-10T03:54:40.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.773+0000 7f840ee7c640 1 -- 172.21.15.55:0/1875264370 wait complete. 2024-05-10T03:54:40.787 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T03:54:40.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:40.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.893+0000 7f75b7208640 1 Processor -- start 2024-05-10T03:54:40.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.893+0000 7f75b7208640 1 -- start start 2024-05-10T03:54:40.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.893+0000 7f75b7208640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f75b00d3ef0 0x7f75b015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.893+0000 7f75b7208640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b00d2590 con 0x7f75b00d2fe0 2024-05-10T03:54:40.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.893+0000 7f75b7208640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b00d0610 con 0x7f75b00d21b0 2024-05-10T03:54:40.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.893+0000 7f75b7208640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f75b00d1190 con 0x7f75b00d3ef0 2024-05-10T03:54:40.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75affff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f75b00d2fe0 0x7f75b00d37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44174/0 (socket says 172.21.15.55:44174) 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75affff640 1 -- 172.21.15.55:0/3849116463 learned_addr learned my addr 172.21.15.55:0/3849116463 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75b57a5640 1 --2- 172.21.15.55:0/3849116463 >> v2:172.21.15.64:3300/0 conn(0x7f75b00d3ef0 0x7f75b015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75af7fe640 1 -- 172.21.15.55:0/3849116463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613356536 0 0) 0x7f75b00d2590 con 0x7f75b00d2fe0 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75af7fe640 1 -- 172.21.15.55:0/3849116463 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f759c003520 con 0x7f75b00d2fe0 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75b57a5640 1 -- 172.21.15.55:0/3849116463 >> v1:172.21.15.64:6789/0 conn(0x7f75b00d21b0 legacy=0x7f75b00cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75b57a5640 1 -- 172.21.15.55:0/3849116463 >> v1:172.21.15.55:6789/0 conn(0x7f75b00d2fe0 legacy=0x7f75b00d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.894+0000 7f75b57a5640 1 -- 172.21.15.55:0/3849116463 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b00d08f0 con 0x7f75b00d3ef0 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.895+0000 7f75b57a5640 1 --2- 172.21.15.55:0/3849116463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d3ef0 0x7f75b015ee50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75980097a0 tx=0x7f759802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d0c27077d975ad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.895+0000 7f75af7fe640 1 -- 172.21.15.55:0/3849116463 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598037070 con 0x7f75b00d3ef0 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.895+0000 7f75af7fe640 1 -- 172.21.15.55:0/3849116463 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598032440 con 0x7f75b00d3ef0 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.895+0000 7f75af7fe640 1 -- 172.21.15.55:0/3849116463 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598032810 con 0x7f75b00d3ef0 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 -- 172.21.15.55:0/3849116463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d3ef0 msgr2=0x7f75b015ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 --2- 172.21.15.55:0/3849116463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d3ef0 0x7f75b015ee50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75980097a0 tx=0x7f759802a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 -- 172.21.15.55:0/3849116463 shutdown_connections 2024-05-10T03:54:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 --2- 172.21.15.55:0/3849116463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d3ef0 0x7f75b015ee50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 -- 172.21.15.55:0/3849116463 >> 172.21.15.55:0/3849116463 conn(0x7f75b009e540 msgr2=0x7f75b00d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 -- 172.21.15.55:0/3849116463 shutdown_connections 2024-05-10T03:54:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.896+0000 7f75b7208640 1 -- 172.21.15.55:0/3849116463 wait complete. 2024-05-10T03:54:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.897+0000 7f75b7208640 1 Processor -- start 2024-05-10T03:54:40.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.897+0000 7f75b7208640 1 -- start start 2024-05-10T03:54:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d21b0 0x7f75b0157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75b00d2fe0 0x7f75b01516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75b00d3ef0 0x7f75b00cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f75b00d0eb0 con 0x7f75b00d2fe0 2024-05-10T03:54:40.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f75b00d6170 con 0x7f75b00d21b0 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f75b00b5a40 con 0x7f75b00d3ef0 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75b00d2fe0 0x7f75b01516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75b00d2fe0 0x7f75b01516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37986/0 (socket says 172.21.15.55:37986) 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 -- 172.21.15.55:0/362710855 learned_addr learned my addr 172.21.15.55:0/362710855 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b57a5640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75b00d3ef0 0x7f75b00cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b4fa4640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d21b0 0x7f75b0157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 -- 172.21.15.55:0/362710855 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75b00d3ef0 msgr2=0x7f75b00cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f75b00d3ef0 0x7f75b00cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 -- 172.21.15.55:0/362710855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d21b0 msgr2=0x7f75b0157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f75b00d21b0 0x7f75b0157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 -- 172.21.15.55:0/362710855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b01562f0 con 0x7f75b00d2fe0 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75affff640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75b00d2fe0 0x7f75b01516d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f75a000cbb0 tx=0x7f75a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0017070 con 0x7f75b00d2fe0 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a000ad60 con 0x7f75b00d2fe0 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b01565d0 con 0x7f75b00d2fe0 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.898+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0012640 con 0x7f75b00d2fe0 2024-05-10T03:54:40.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.899+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b0156b90 con 0x7f75b00d2fe0 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.899+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75b006a7e0 con 0x7f75b00d2fe0 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.900+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75a001a070 con 0x7f75b00d2fe0 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75ad7fa640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75900762d0 0x7f7590078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f75a0097060 con 0x7f75b00d2fe0 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75b4fa4640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75900762d0 0x7f7590078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75ad7fa640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f759007c190 0x7f759007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f759007ec60 con 0x7f759007c190 2024-05-10T03:54:40.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f75a009e050 con 0x7f75b00d2fe0 2024-05-10T03:54:40.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75b57a5640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f759007c190 0x7f759007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:40.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75b4fa4640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75900762d0 0x7f7590078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75a8000c00 tx=0x7f75a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.901+0000 7f75b57a5640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f759007c190 0x7f759007e5b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:40.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.902+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== osd.3 v2:172.21.15.55:6808/600411321 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f759007ec60 con 0x7f759007c190 2024-05-10T03:54:40.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.915+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 --> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f75b0157150 con 0x7f759007c190 2024-05-10T03:54:40.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75ad7fa640 1 -- 172.21.15.55:0/362710855 <== osd.3 v2:172.21.15.55:6808/600411321 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f75b0157150 con 0x7f759007c190 2024-05-10T03:54:40.919 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:40.919 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:40.919 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f759007c190 msgr2=0x7f759007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6808/600411321,v1:172.21.15.55:6809/600411321] conn(0x7f759007c190 0x7f759007e5b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75900762d0 msgr2=0x7f7590078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f75900762d0 0x7f7590078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f75a8000c00 tx=0x7f75a8009040 comp rx=0 tx=0).stop 2024-05-10T03:54:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75b00d2fe0 msgr2=0x7f75b01516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 --2- 172.21.15.55:0/362710855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75b00d2fe0 0x7f75b01516d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f75a000cbb0 tx=0x7f75a000a430 comp rx=0 tx=0).stop 2024-05-10T03:54:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b57a5640 1 -- 172.21.15.55:0/362710855 reap_dead start 2024-05-10T03:54:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 shutdown_connections 2024-05-10T03:54:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 >> 172.21.15.55:0/362710855 conn(0x7f75b009e540 msgr2=0x7f75b01630e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 shutdown_connections 2024-05-10T03:54:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:40.916+0000 7f75b7208640 1 -- 172.21.15.55:0/362710855 wait complete. 2024-05-10T03:54:40.929 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T03:54:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.031+0000 7f8443f46640 1 Processor -- start 2024-05-10T03:54:41.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.032+0000 7f8443f46640 1 -- start start 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.032+0000 7f8443f46640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843c15f450 0x7f843c0cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.032+0000 7f8443f46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c15f830 0x7f843c0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.032+0000 7f8443f46640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843c0b5da0 con 0x7f843c0d03b0 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.032+0000 7f8443f46640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f843c163460 con 0x7f843c15f450 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.032+0000 7f8443f46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f843c0b6080 con 0x7f843c15f830 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f8441ce2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843c15f450 0x7f843c0cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f84424e3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f843c0d03b0 0x7f843c0d5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44186/0 (socket says 172.21.15.55:44186) 2024-05-10T03:54:41.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f84424e3640 1 -- 172.21.15.55:0/3732010114 learned_addr learned my addr 172.21.15.55:0/3732010114 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:41.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f8441ce2640 1 -- 172.21.15.55:0/3732010114 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c15f830 msgr2=0x7f843c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f8441ce2640 1 --2- 172.21.15.55:0/3732010114 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c15f830 0x7f843c0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f8441ce2640 1 -- 172.21.15.55:0/3732010114 >> v1:172.21.15.55:6789/0 conn(0x7f843c0d03b0 legacy=0x7f843c0d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f8440ce0640 1 -- 172.21.15.55:0/3732010114 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431349355 0 0) 0x7f843c0b5da0 con 0x7f843c0d03b0 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.033+0000 7f8441ce2640 1 -- 172.21.15.55:0/3732010114 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c0d3020 con 0x7f843c15f450 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8441ce2640 1 --2- 172.21.15.55:0/3732010114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cfe70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f84380097a0 tx=0x7f843802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f489032fcc4048d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8440ce0640 1 -- 172.21.15.55:0/3732010114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438037070 con 0x7f843c15f450 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8440ce0640 1 -- 172.21.15.55:0/3732010114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8438032440 con 0x7f843c15f450 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8440ce0640 1 -- 172.21.15.55:0/3732010114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438032810 con 0x7f843c15f450 2024-05-10T03:54:41.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8443f46640 1 -- 172.21.15.55:0/3732010114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 msgr2=0x7f843c0cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8443f46640 1 --2- 172.21.15.55:0/3732010114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cfe70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f84380097a0 tx=0x7f843802a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8443f46640 1 -- 172.21.15.55:0/3732010114 shutdown_connections 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8443f46640 1 --2- 172.21.15.55:0/3732010114 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c15f830 0x7f843c0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8443f46640 1 --2- 172.21.15.55:0/3732010114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cfe70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.034+0000 7f8443f46640 1 -- 172.21.15.55:0/3732010114 >> 172.21.15.55:0/3732010114 conn(0x7f843c08ec90 msgr2=0x7f843c09e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.035+0000 7f8443f46640 1 -- 172.21.15.55:0/3732010114 shutdown_connections 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.035+0000 7f8443f46640 1 -- 172.21.15.55:0/3732010114 wait complete. 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 Processor -- start 2024-05-10T03:54:41.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 -- start start 2024-05-10T03:54:41.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c0d03b0 0x7f843c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f843c15f830 0x7f843c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f843c0d5af0 con 0x7f843c15f450 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.036+0000 7f8443f46640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f843c0d5970 con 0x7f843c15f830 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f8443f46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f843c0b5740 con 0x7f843c0d03b0 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38012/0 (socket says 172.21.15.55:38012) 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 -- 172.21.15.55:0/3439563133 learned_addr learned my addr 172.21.15.55:0/3439563133 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f8441ce2640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c0d03b0 0x7f843c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84424e3640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f843c15f830 0x7f843c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 -- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c0d03b0 msgr2=0x7f843c1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c0d03b0 0x7f843c1f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 -- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f843c15f830 msgr2=0x7f843c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f843c15f830 0x7f843c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 -- 172.21.15.55:0/3439563133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c1f68a0 con 0x7f843c15f450 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84424e3640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f843c15f830 0x7f843c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84414e1640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cd3f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f842c00b440 tx=0x7f842c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c015020 con 0x7f843c15f450 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c011890 con 0x7f843c15f450 2024-05-10T03:54:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843c0ca3a0 con 0x7f843c15f450 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c011c80 con 0x7f843c15f450 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.037+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843c0cde70 con 0x7f843c15f450 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.038+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843c06a7e0 con 0x7f843c15f450 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.039+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f842c018020 con 0x7f843c15f450 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.039+0000 7f84327fc640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f84200762d0 0x7f8420078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.040+0000 7f8441ce2640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f84200762d0 0x7f8420078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.040+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f842c097490 con 0x7f843c15f450 2024-05-10T03:54:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.040+0000 7f8441ce2640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f84200762d0 0x7f8420078790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8438034000 tx=0x7f843802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.044+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f842c01f020 con 0x7f843c15f450 2024-05-10T03:54:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.239+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f843c0cf790 con 0x7f84200762d0 2024-05-10T03:54:41.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.240+0000 7f84327fc640 1 -- 172.21.15.55:0/3439563133 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f843c0cf790 con 0x7f84200762d0 2024-05-10T03:54:41.243 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f84200762d0 msgr2=0x7f8420078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f84200762d0 0x7f8420078790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8438034000 tx=0x7f843802e000 comp rx=0 tx=0).stop 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 msgr2=0x7f843c0cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cd3f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f842c00b440 tx=0x7f842c00b900 comp rx=0 tx=0).stop 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 shutdown_connections 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f843c15f830 0x7f843c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f84200762d0 0x7f8420078790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843c15f450 0x7f843c0cd3f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 --2- 172.21.15.55:0/3439563133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f843c0d03b0 0x7f843c1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 >> 172.21.15.55:0/3439563133 conn(0x7f843c08ec90 msgr2=0x7f843c1635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 shutdown_connections 2024-05-10T03:54:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.242+0000 7f8443f46640 1 -- 172.21.15.55:0/3439563133 wait complete. 2024-05-10T03:54:41.255 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T03:54:41.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.361+0000 7f34d3719640 1 Processor -- start 2024-05-10T03:54:41.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.361+0000 7f34d3719640 1 -- start start 2024-05-10T03:54:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d3719640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0b3280 0x7f34cc0d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d3719640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34cc0723e0 0x7f34cc072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d3719640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc073180 con 0x7f34cc145b30 2024-05-10T03:54:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d3719640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc0cf2e0 con 0x7f34cc0723e0 2024-05-10T03:54:41.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d3719640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf5c0 con 0x7f34cc0b3280 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34cc0723e0 0x7f34cc072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34cc0723e0 0x7f34cc072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38026/0 (socket says 172.21.15.55:38026) 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 -- 172.21.15.55:0/563544742 learned_addr learned my addr 172.21.15.55:0/563544742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d0cb4640 1 --2- 172.21.15.55:0/563544742 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0b3280 0x7f34cc0d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 -- 172.21.15.55:0/563544742 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0b3280 msgr2=0x7f34cc0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 --2- 172.21.15.55:0/563544742 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0b3280 0x7f34cc0d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 -- 172.21.15.55:0/563544742 >> v1:172.21.15.64:6789/0 conn(0x7f34cc145b30 legacy=0x7f34cc0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.362+0000 7f34d1cb6640 1 -- 172.21.15.55:0/563544742 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0cf8a0 con 0x7f34cc0723e0 2024-05-10T03:54:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.363+0000 7f34d1cb6640 1 --2- 172.21.15.55:0/563544742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc0723e0 0x7f34cc072890 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009e50 tx=0x7f34c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceeb1068195deb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.363+0000 7f34c3fff640 1 -- 172.21.15.55:0/563544742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4036070 con 0x7f34cc0723e0 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.363+0000 7f34c3fff640 1 -- 172.21.15.55:0/563544742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4031600 con 0x7f34cc0723e0 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.363+0000 7f34c3fff640 1 -- 172.21.15.55:0/563544742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40319d0 con 0x7f34cc0723e0 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 -- 172.21.15.55:0/563544742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc0723e0 msgr2=0x7f34cc072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 --2- 172.21.15.55:0/563544742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc0723e0 0x7f34cc072890 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009e50 tx=0x7f34c402a680 comp rx=0 tx=0).stop 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 -- 172.21.15.55:0/563544742 shutdown_connections 2024-05-10T03:54:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 --2- 172.21.15.55:0/563544742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc0723e0 0x7f34cc072890 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 --2- 172.21.15.55:0/563544742 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0b3280 0x7f34cc0d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 -- 172.21.15.55:0/563544742 >> 172.21.15.55:0/563544742 conn(0x7f34cc06f860 msgr2=0x7f34cc06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 -- 172.21.15.55:0/563544742 shutdown_connections 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.364+0000 7f34d3719640 1 -- 172.21.15.55:0/563544742 wait complete. 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.365+0000 7f34d3719640 1 Processor -- start 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.365+0000 7f34d3719640 1 -- start start 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d3719640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0723e0 0x7f34cc140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d3719640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34cc0b3280 0x7f34cc14f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d3719640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc145b30 0x7f34cc14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d3719640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc072dd0 con 0x7f34cc145b30 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d3719640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b3f90 con 0x7f34cc0b3280 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d3719640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc13fba0 con 0x7f34cc0723e0 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc145b30 0x7f34cc14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc145b30 0x7f34cc14f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38040/0 (socket says 172.21.15.55:38040) 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 -- 172.21.15.55:0/1753624290 learned_addr learned my addr 172.21.15.55:0/1753624290 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d14b5640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0723e0 0x7f34cc140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d0cb4640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34cc0b3280 0x7f34cc14f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 -- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0723e0 msgr2=0x7f34cc140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0723e0 0x7f34cc140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 -- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34cc0b3280 msgr2=0x7f34cc14f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34cc0b3280 0x7f34cc14f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 -- 172.21.15.55:0/1753624290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc13fe60 con 0x7f34cc145b30 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d14b5640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f34cc0723e0 0x7f34cc140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d0cb4640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f34cc0b3280 0x7f34cc14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34d1cb6640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc145b30 0x7f34cc14f8a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34c4034040 tx=0x7f34c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.366+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c403f020 con 0x7f34cc145b30 2024-05-10T03:54:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.367+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4037040 con 0x7f34cc145b30 2024-05-10T03:54:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.367+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc140140 con 0x7f34cc145b30 2024-05-10T03:54:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.367+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4036070 con 0x7f34cc145b30 2024-05-10T03:54:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.367+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc140700 con 0x7f34cc145b30 2024-05-10T03:54:41.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.367+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34cc06a7e0 con 0x7f34cc145b30 2024-05-10T03:54:41.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.368+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34c4042020 con 0x7f34cc145b30 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34c1ffb640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f34b00762d0 0x7f34b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f34c40b7da0 con 0x7f34cc145b30 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34d14b5640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f34b00762d0 0x7f34b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34c1ffb640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7f34b007c190 0x7f34b007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 --> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34b007ec60 con 0x7f34b007c190 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f34c40b8230 con 0x7f34cc145b30 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34d0cb4640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7f34b007c190 0x7f34b007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.369+0000 7f34d14b5640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f34b00762d0 0x7f34b0078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f34c8007fd0 tx=0x7f34c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.370+0000 7f34d0cb4640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7f34b007c190 0x7f34b007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.371+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== osd.4 v2:172.21.15.64:6809/945910103 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34b007ec60 con 0x7f34b007c190 2024-05-10T03:54:41.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.384+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 --> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f34cc06d020 con 0x7f34b007c190 2024-05-10T03:54:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.384+0000 7f34c1ffb640 1 -- 172.21.15.55:0/1753624290 <== osd.4 v2:172.21.15.64:6809/945910103 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f34cc06d020 con 0x7f34b007c190 2024-05-10T03:54:41.387 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:41.387 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:41.387 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.384+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7f34b007c190 msgr2=0x7f34b007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.384+0000 7f34d3719640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.64:6809/945910103,v1:172.21.15.64:6811/945910103] conn(0x7f34b007c190 0x7f34b007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f34b00762d0 msgr2=0x7f34b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f34b00762d0 0x7f34b0078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f34c8007fd0 tx=0x7f34c8009040 comp rx=0 tx=0).stop 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc145b30 msgr2=0x7f34cc14f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 --2- 172.21.15.55:0/1753624290 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34cc145b30 0x7f34cc14f8a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34c4034040 tx=0x7f34c4004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d1cb6640 1 -- 172.21.15.55:0/1753624290 reap_dead start 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 shutdown_connections 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 >> 172.21.15.55:0/1753624290 conn(0x7f34cc06f860 msgr2=0x7f34cc0cffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 shutdown_connections 2024-05-10T03:54:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.385+0000 7f34d3719640 1 -- 172.21.15.55:0/1753624290 wait complete. 2024-05-10T03:54:41.398 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T03:54:41.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.500+0000 7f5e63504640 1 Processor -- start 2024-05-10T03:54:41.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.500+0000 7f5e63504640 1 -- start start 2024-05-10T03:54:41.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e63504640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5e5c0b5910 0x7f5e5c0d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e63504640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5c0b5da0 con 0x7f5e5c15f450 2024-05-10T03:54:41.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e63504640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5c0b6080 con 0x7f5e5c15f830 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e63504640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5c163460 con 0x7f5e5c0b5910 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e612a0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5e5c15f450 0x7f5e5c0cfe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44200/0 (socket says 172.21.15.55:44200) 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e612a0640 1 -- 172.21.15.55:0/1653037286 learned_addr learned my addr 172.21.15.55:0/1653037286 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e61aa1640 1 --2- 172.21.15.55:0/1653037286 >> v2:172.21.15.64:3300/0 conn(0x7f5e5c0b5910 0x7f5e5c0d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143860930 0 0) 0x7f5e5c0b5da0 con 0x7f5e5c15f450 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e48003520 con 0x7f5e5c15f450 2024-05-10T03:54:41.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602634752 0 0) 0x7f5e5c0b6080 con 0x7f5e5c15f830 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e5c0b5da0 con 0x7f5e5c15f830 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699242306 0 0) 0x7f5e48003520 con 0x7f5e5c15f450 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.501+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 >> v2:172.21.15.64:3300/0 conn(0x7f5e5c0b5910 msgr2=0x7f5e5c0d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 --2- 172.21.15.55:0/1653037286 >> v2:172.21.15.64:3300/0 conn(0x7f5e5c0b5910 0x7f5e5c0d5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 >> v1:172.21.15.64:6789/0 conn(0x7f5e5c15f830 legacy=0x7f5e5c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c0d3020 con 0x7f5e5c15f450 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f5e580016f0 con 0x7f5e5c15f450 2024-05-10T03:54:41.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 >> v1:172.21.15.55:6789/0 conn(0x7f5e5c15f450 legacy=0x7f5e5c0cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e48004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e48004800 0x7f5e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e48005210 0x7f5e4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c163460 con 0x7f5e48003c30 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4800c140 con 0x7f5e48004800 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4800c340 con 0x7f5e48005210 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e612a0640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e48004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e60a9f640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e48004800 0x7f5e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e61aa1640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e48005210 0x7f5e4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e612a0640 1 -- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e48005210 msgr2=0x7f5e4800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e612a0640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e48005210 0x7f5e4800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e612a0640 1 -- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e48004800 msgr2=0x7f5e48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e612a0640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e48004800 0x7f5e48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e612a0640 1 -- 172.21.15.55:0/1653037286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e48003520 con 0x7f5e48003c30 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.502+0000 7f5e61aa1640 1 -- 172.21.15.55:0/1653037286 reap_dead start 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e612a0640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e48004030 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c190 tx=0x7f5e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cf57a5dfc9ac51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58007cc0 con 0x7f5e48003c30 2024-05-10T03:54:41.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e58005ad0 con 0x7f5e48003c30 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e53fff640 1 -- 172.21.15.55:0/1653037286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58007070 con 0x7f5e48003c30 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e63504640 1 -- 172.21.15.55:0/1653037286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 msgr2=0x7f5e48004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e63504640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e48004030 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c190 tx=0x7f5e48005830 comp rx=0 tx=0).stop 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e63504640 1 -- 172.21.15.55:0/1653037286 shutdown_connections 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e63504640 1 --2- 172.21.15.55:0/1653037286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e48004030 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.503+0000 7f5e63504640 1 -- 172.21.15.55:0/1653037286 >> 172.21.15.55:0/1653037286 conn(0x7f5e5c08ec90 msgr2=0x7f5e5c09e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.504+0000 7f5e63504640 1 -- 172.21.15.55:0/1653037286 shutdown_connections 2024-05-10T03:54:41.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.504+0000 7f5e63504640 1 -- 172.21.15.55:0/1653037286 wait complete. 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.505+0000 7f5e63504640 1 Processor -- start 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.505+0000 7f5e63504640 1 -- start start 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.505+0000 7f5e63504640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e5c161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.505+0000 7f5e63504640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e5c0c8e00 0x7f5e5c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e63504640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e5c15a4c0 0x7f5e5c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e63504640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c0b5380 con 0x7f5e48003c30 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e63504640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c0b5200 con 0x7f5e5c15a4c0 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e63504640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5c0b5500 con 0x7f5e5c0c8e00 2024-05-10T03:54:41.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e5c161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e5c161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38060/0 (socket says 172.21.15.55:38060) 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 -- 172.21.15.55:0/3767445373 learned_addr learned my addr 172.21.15.55:0/3767445373 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e60a9f640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e5c0c8e00 0x7f5e5c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 -- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e5c0c8e00 msgr2=0x7f5e5c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e5c0c8e00 0x7f5e5c0ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 -- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e5c15a4c0 msgr2=0x7f5e5c15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e5c15a4c0 0x7f5e5c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 -- 172.21.15.55:0/3767445373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c15aeb0 con 0x7f5e48003c30 2024-05-10T03:54:41.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e612a0640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e5c161260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c1f0 tx=0x7f5e5c0b5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58042070 con 0x7f5e48003c30 2024-05-10T03:54:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e580016f0 con 0x7f5e48003c30 2024-05-10T03:54:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c0c9650 con 0x7f5e48003c30 2024-05-10T03:54:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.506+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58037040 con 0x7f5e48003c30 2024-05-10T03:54:41.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.507+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c0c9c10 con 0x7f5e48003c30 2024-05-10T03:54:41.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.508+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5c06a7e0 con 0x7f5e48003c30 2024-05-10T03:54:41.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.508+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e58007070 con 0x7f5e48003c30 2024-05-10T03:54:41.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.509+0000 7f5e51ffb640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5e40076300 0x7f5e400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.509+0000 7f5e60a9f640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5e40076300 0x7f5e400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.509+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f5e580b6990 con 0x7f5e48003c30 2024-05-10T03:54:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.509+0000 7f5e60a9f640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5e40076300 0x7f5e400787c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c06e570 tx=0x7f5e4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.513+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5e5807ff00 con 0x7f5e48003c30 2024-05-10T03:54:41.653 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:54:41.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:54:41.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.706+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5e5c08f340 con 0x7f5e40076300 2024-05-10T03:54:41.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.706+0000 7f5e51ffb640 1 -- 172.21.15.55:0/3767445373 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e5c08f340 con 0x7f5e40076300 2024-05-10T03:54:41.709 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T03:54:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5e40076300 msgr2=0x7f5e400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5e40076300 0x7f5e400787c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c06e570 tx=0x7f5e4c009040 comp rx=0 tx=0).stop 2024-05-10T03:54:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 msgr2=0x7f5e5c161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e5c161260 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c1f0 tx=0x7f5e5c0b5f70 comp rx=0 tx=0).stop 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 shutdown_connections 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e5c15a4c0 0x7f5e5c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e5c0c8e00 0x7f5e5c0ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f5e40076300 0x7f5e400787c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 --2- 172.21.15.55:0/3767445373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e48003c30 0x7f5e5c161260 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 >> 172.21.15.55:0/3767445373 conn(0x7f5e5c08ec90 msgr2=0x7f5e5c163600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 shutdown_connections 2024-05-10T03:54:41.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.708+0000 7f5e63504640 1 -- 172.21.15.55:0/3767445373 wait complete. 2024-05-10T03:54:41.722 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T03:54:41.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:41.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.868+0000 7f145ba2c640 1 Processor -- start 2024-05-10T03:54:41.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.868+0000 7f145ba2c640 1 -- start start 2024-05-10T03:54:41.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f145ba2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14540b5ff0 0x7f14540b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f145ba2c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14540b2b70 0x7f14540b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f145ba2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14540b63d0 con 0x7f1454073a70 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f145ba2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f14540cfff0 con 0x7f14540b5ff0 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f145ba2c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f14540d02d0 con 0x7f14540b2b70 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f14597c8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14540b5ff0 0x7f14540b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f1459fc9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1454073a70 0x7f1454073ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44206/0 (socket says 172.21.15.55:44206) 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.869+0000 7f1459fc9640 1 -- 172.21.15.55:0/2694564833 learned_addr learned my addr 172.21.15.55:0/2694564833 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:41.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.870+0000 7f1458fc7640 1 --2- 172.21.15.55:0/2694564833 >> v2:172.21.15.64:3300/0 conn(0x7f14540b2b70 0x7f14540b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.870+0000 7f14597c8640 1 -- 172.21.15.55:0/2694564833 >> v2:172.21.15.64:3300/0 conn(0x7f14540b2b70 msgr2=0x7f14540b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:41.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.870+0000 7f14597c8640 1 --2- 172.21.15.55:0/2694564833 >> v2:172.21.15.64:3300/0 conn(0x7f14540b2b70 0x7f14540b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.870+0000 7f14597c8640 1 -- 172.21.15.55:0/2694564833 >> v1:172.21.15.55:6789/0 conn(0x7f1454073a70 legacy=0x7f1454073ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.870+0000 7f14597c8640 1 -- 172.21.15.55:0/2694564833 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14540d05b0 con 0x7f14540b5ff0 2024-05-10T03:54:41.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.870+0000 7f144bfff640 1 -- 172.21.15.55:0/2694564833 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080113502 0 0) 0x7f14540b63d0 con 0x7f1454073a70 2024-05-10T03:54:41.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f14597c8640 1 --2- 172.21.15.55:0/2694564833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14540b5ff0 0x7f14540b3ee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1454070780 tx=0x7f145002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d810d47111ad3ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f144bfff640 1 -- 172.21.15.55:0/2694564833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450037070 con 0x7f14540b5ff0 2024-05-10T03:54:41.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f144bfff640 1 -- 172.21.15.55:0/2694564833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450032440 con 0x7f14540b5ff0 2024-05-10T03:54:41.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f144bfff640 1 -- 172.21.15.55:0/2694564833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450032810 con 0x7f14540b5ff0 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 -- 172.21.15.55:0/2694564833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14540b5ff0 msgr2=0x7f14540b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 --2- 172.21.15.55:0/2694564833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14540b5ff0 0x7f14540b3ee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1454070780 tx=0x7f145002a1a0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 -- 172.21.15.55:0/2694564833 shutdown_connections 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 --2- 172.21.15.55:0/2694564833 >> v2:172.21.15.64:3300/0 conn(0x7f14540b2b70 0x7f14540b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 --2- 172.21.15.55:0/2694564833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14540b5ff0 0x7f14540b3ee0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 -- 172.21.15.55:0/2694564833 >> 172.21.15.55:0/2694564833 conn(0x7f145406f860 msgr2=0x7f145406c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 -- 172.21.15.55:0/2694564833 shutdown_connections 2024-05-10T03:54:41.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.871+0000 7f145ba2c640 1 -- 172.21.15.55:0/2694564833 wait complete. 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 Processor -- start 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 -- start start 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1454073a70 0x7f1454149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14540b2b70 0x7f1454143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14540b5ff0 0x7f1454142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f14540b4420 con 0x7f1454073a70 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f14540d0b70 con 0x7f14540b5ff0 2024-05-10T03:54:41.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f145ba2c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f14540d1090 con 0x7f14540b2b70 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f14597c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1454073a70 0x7f1454149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f14597c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1454073a70 0x7f1454149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38068/0 (socket says 172.21.15.55:38068) 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.873+0000 7f14597c8640 1 -- 172.21.15.55:0/1670142561 learned_addr learned my addr 172.21.15.55:0/1670142561 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f14597c8640 1 -- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14540b2b70 msgr2=0x7f1454143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f14597c8640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f14540b2b70 0x7f1454143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f14597c8640 1 -- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14540b5ff0 msgr2=0x7f1454142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f14597c8640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14540b5ff0 0x7f1454142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f14597c8640 1 -- 172.21.15.55:0/1670142561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1454149a70 con 0x7f1454073a70 2024-05-10T03:54:41.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f14597c8640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1454073a70 0x7f1454149370 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1450035040 tx=0x7f14500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450037050 con 0x7f1454073a70 2024-05-10T03:54:41.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450038040 con 0x7f1454073a70 2024-05-10T03:54:41.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1454146850 con 0x7f1454073a70 2024-05-10T03:54:41.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450004470 con 0x7f1454073a70 2024-05-10T03:54:41.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.874+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1454146e10 con 0x7f1454073a70 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.875+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f145406a7e0 con 0x7f1454073a70 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1450030900 con 0x7f1454073a70 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1449ffb640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14380762d0 0x7f1438078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f14500b7d80 con 0x7f1454073a70 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1458fc7640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14380762d0 0x7f1438078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1449ffb640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f143807c190 0x7f143807e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 --> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f145002cea0 con 0x7f143807c190 2024-05-10T03:54:41.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.876+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f14500ba480 con 0x7f1454073a70 2024-05-10T03:54:41.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.877+0000 7f1458fc7640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14380762d0 0x7f1438078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1454148470 tx=0x7f1444008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.877+0000 7f1459fc9640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f143807c190 0x7f143807e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:41.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.877+0000 7f1459fc9640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f143807c190 0x7f143807e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:41.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.878+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== osd.5 v2:172.21.15.64:6808/3692026818 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f145002cea0 con 0x7f143807c190 2024-05-10T03:54:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.891+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 --> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1454147260 con 0x7f143807c190 2024-05-10T03:54:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f1449ffb640 1 -- 172.21.15.55:0/1670142561 <== osd.5 v2:172.21.15.64:6808/3692026818 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1454147260 con 0x7f143807c190 2024-05-10T03:54:41.895 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:41.895 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:41.895 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f143807c190 msgr2=0x7f143807e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.64:6808/3692026818,v1:172.21.15.64:6810/3692026818] conn(0x7f143807c190 0x7f143807e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14380762d0 msgr2=0x7f1438078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f14380762d0 0x7f1438078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1454148470 tx=0x7f1444008040 comp rx=0 tx=0).stop 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1454073a70 msgr2=0x7f1454149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 --2- 172.21.15.55:0/1670142561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1454073a70 0x7f1454149370 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1450035040 tx=0x7f14500046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:41.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f1459fc9640 1 -- 172.21.15.55:0/1670142561 reap_dead start 2024-05-10T03:54:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 shutdown_connections 2024-05-10T03:54:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 >> 172.21.15.55:0/1670142561 conn(0x7f145406f860 msgr2=0x7f14540b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 shutdown_connections 2024-05-10T03:54:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:41.892+0000 7f145ba2c640 1 -- 172.21.15.55:0/1670142561 wait complete. 2024-05-10T03:54:41.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T03:54:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.008+0000 7f89d639e640 1 Processor -- start 2024-05-10T03:54:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.008+0000 7f89d639e640 1 -- start start 2024-05-10T03:54:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d639e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f89d015f290 0x7f89d00d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d639e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d00cfc00 con 0x7f89d00d5d90 2024-05-10T03:54:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d639e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d00d3e00 con 0x7f89d015f670 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d639e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f89d00cfea0 con 0x7f89d015f290 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d5b9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89d00d5d90 0x7f89d00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44220/0 (socket says 172.21.15.55:44220) 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d5b9d640 1 -- 172.21.15.55:0/3918832275 learned_addr learned my addr 172.21.15.55:0/3918832275 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d539c640 1 --2- 172.21.15.55:0/3918832275 >> v2:172.21.15.64:3300/0 conn(0x7f89d015f290 0x7f89d00d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89c7fff640 1 -- 172.21.15.55:0/3918832275 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976978937 0 0) 0x7f89d00cfc00 con 0x7f89d00d5d90 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89c7fff640 1 -- 172.21.15.55:0/3918832275 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89bc003520 con 0x7f89d00d5d90 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d539c640 1 -- 172.21.15.55:0/3918832275 >> v1:172.21.15.64:6789/0 conn(0x7f89d015f670 legacy=0x7f89d00d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d539c640 1 -- 172.21.15.55:0/3918832275 >> v1:172.21.15.55:6789/0 conn(0x7f89d00d5d90 legacy=0x7f89d00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.009+0000 7f89d539c640 1 -- 172.21.15.55:0/3918832275 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d00d0180 con 0x7f89d015f290 2024-05-10T03:54:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.010+0000 7f89d539c640 1 --2- 172.21.15.55:0/3918832275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d00d0c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009d90 tx=0x7f89cc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5238fd0bedf7a468 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.010+0000 7f89c7fff640 1 -- 172.21.15.55:0/3918832275 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc007740 con 0x7f89d015f290 2024-05-10T03:54:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.010+0000 7f89c7fff640 1 -- 172.21.15.55:0/3918832275 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc0078e0 con 0x7f89d015f290 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.010+0000 7f89c7fff640 1 -- 172.21.15.55:0/3918832275 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc007cb0 con 0x7f89d015f290 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 -- 172.21.15.55:0/3918832275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 msgr2=0x7f89d00d0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 --2- 172.21.15.55:0/3918832275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d00d0c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009d90 tx=0x7f89cc02a6f0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 -- 172.21.15.55:0/3918832275 shutdown_connections 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 --2- 172.21.15.55:0/3918832275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d00d0c60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 -- 172.21.15.55:0/3918832275 >> 172.21.15.55:0/3918832275 conn(0x7f89d009e450 msgr2=0x7f89d00d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 -- 172.21.15.55:0/3918832275 shutdown_connections 2024-05-10T03:54:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.011+0000 7f89d639e640 1 -- 172.21.15.55:0/3918832275 wait complete. 2024-05-10T03:54:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.012+0000 7f89d639e640 1 Processor -- start 2024-05-10T03:54:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.012+0000 7f89d639e640 1 -- start start 2024-05-10T03:54:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d639e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 0x7f89d01617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d639e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d639e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f89d015f670 0x7f89d0154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d639e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f89d00d2160 con 0x7f89d00d5d90 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d639e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f89d00d0740 con 0x7f89d015f290 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d639e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f89d00d22e0 con 0x7f89d015f670 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d539c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 0x7f89d01617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d539c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 0x7f89d01617f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38072/0 (socket says 172.21.15.55:38072) 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d539c640 1 -- 172.21.15.55:0/480213494 learned_addr learned my addr 172.21.15.55:0/480213494 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d4b9b640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.013+0000 7f89d5b9d640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f89d015f670 0x7f89d0154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d539c640 1 -- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f89d015f670 msgr2=0x7f89d0154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d539c640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f89d015f670 0x7f89d0154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d539c640 1 -- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 msgr2=0x7f89d0154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d539c640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d0154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d539c640 1 -- 172.21.15.55:0/480213494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d00b6ac0 con 0x7f89d00d5d90 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d539c640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 0x7f89d01617f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009d90 tx=0x7f89cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc040070 con 0x7f89d00d5d90 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc031c40 con 0x7f89d00d5d90 2024-05-10T03:54:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d00b6d60 con 0x7f89d00d5d90 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc009450 con 0x7f89d00d5d90 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.014+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d00b7320 con 0x7f89d00d5d90 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.015+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d00b7750 con 0x7f89d00d5d90 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.016+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f89cc039040 con 0x7f89d00d5d90 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.016+0000 7f89c5ffb640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f89b40762d0 0x7f89b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.016+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f89cc0b8960 con 0x7f89d00d5d90 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.016+0000 7f89d4b9b640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f89b40762d0 0x7f89b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.017+0000 7f89d4b9b640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f89b40762d0 0x7f89b4078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89d00b5d50 tx=0x7f89c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.021+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f89cc082000 con 0x7f89d00d5d90 2024-05-10T03:54:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.212+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f89d006eb40 con 0x7f89b40762d0 2024-05-10T03:54:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.212+0000 7f89c5ffb640 1 -- 172.21.15.55:0/480213494 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89d006eb40 con 0x7f89b40762d0 2024-05-10T03:54:42.215 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T03:54:42.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f89b40762d0 msgr2=0x7f89b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f89b40762d0 0x7f89b4078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89d00b5d50 tx=0x7f89c0009040 comp rx=0 tx=0).stop 2024-05-10T03:54:42.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 msgr2=0x7f89d01617f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 0x7f89d01617f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009d90 tx=0x7f89cc004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:42.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 shutdown_connections 2024-05-10T03:54:42.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f89d015f670 0x7f89d0154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89d015f290 0x7f89d0154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f89b40762d0 0x7f89b4078790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 --2- 172.21.15.55:0/480213494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00d5d90 0x7f89d01617f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 >> 172.21.15.55:0/480213494 conn(0x7f89d009e450 msgr2=0x7f89d015fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 shutdown_connections 2024-05-10T03:54:42.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.215+0000 7f89d639e640 1 -- 172.21.15.55:0/480213494 wait complete. 2024-05-10T03:54:42.228 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T03:54:42.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.334+0000 7f93e6996640 1 Processor -- start 2024-05-10T03:54:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.334+0000 7f93e6996640 1 -- start start 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e6996640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f93e00d21b0 0x7f93e00cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e6996640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93e00d2fe0 0x7f93e00d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e6996640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e00d2590 con 0x7f93e00d3d20 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e6996640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f93e00d1190 con 0x7f93e00d2fe0 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e6996640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f93e00d6170 con 0x7f93e00d21b0 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93df7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93e00d2fe0 0x7f93e00d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e4f33640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f93e00d3d20 0x7f93e015ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44222/0 (socket says 172.21.15.55:44222) 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93e4f33640 1 -- 172.21.15.55:0/15770553 learned_addr learned my addr 172.21.15.55:0/15770553 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93dffff640 1 --2- 172.21.15.55:0/15770553 >> v2:172.21.15.64:3300/0 conn(0x7f93e00d21b0 0x7f93e00cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93df7fe640 1 -- 172.21.15.55:0/15770553 >> v2:172.21.15.64:3300/0 conn(0x7f93e00d21b0 msgr2=0x7f93e00cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93df7fe640 1 --2- 172.21.15.55:0/15770553 >> v2:172.21.15.64:3300/0 conn(0x7f93e00d21b0 0x7f93e00cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93df7fe640 1 -- 172.21.15.55:0/15770553 >> v1:172.21.15.55:6789/0 conn(0x7f93e00d3d20 legacy=0x7f93e015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93df7fe640 1 -- 172.21.15.55:0/15770553 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e00d0610 con 0x7f93e00d2fe0 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.335+0000 7f93deffd640 1 -- 172.21.15.55:0/15770553 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329379867 0 0) 0x7f93e00d2590 con 0x7f93e00d3d20 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.336+0000 7f93df7fe640 1 --2- 172.21.15.55:0/15770553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d2fe0 0x7f93e00d37e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93e008de00 tx=0x7f93d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289eebf910b14df1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.336+0000 7f93deffd640 1 -- 172.21.15.55:0/15770553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4037070 con 0x7f93e00d2fe0 2024-05-10T03:54:42.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.336+0000 7f93deffd640 1 -- 172.21.15.55:0/15770553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d4032440 con 0x7f93e00d2fe0 2024-05-10T03:54:42.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.336+0000 7f93deffd640 1 -- 172.21.15.55:0/15770553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d402ae60 con 0x7f93e00d2fe0 2024-05-10T03:54:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 -- 172.21.15.55:0/15770553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d2fe0 msgr2=0x7f93e00d37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 --2- 172.21.15.55:0/15770553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d2fe0 0x7f93e00d37e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93e008de00 tx=0x7f93d402a110 comp rx=0 tx=0).stop 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 -- 172.21.15.55:0/15770553 shutdown_connections 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 --2- 172.21.15.55:0/15770553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d2fe0 0x7f93e00d37e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 --2- 172.21.15.55:0/15770553 >> v2:172.21.15.64:3300/0 conn(0x7f93e00d21b0 0x7f93e00cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 -- 172.21.15.55:0/15770553 >> 172.21.15.55:0/15770553 conn(0x7f93e009e540 msgr2=0x7f93e00d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 -- 172.21.15.55:0/15770553 shutdown_connections 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.337+0000 7f93e6996640 1 -- 172.21.15.55:0/15770553 wait complete. 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.338+0000 7f93e6996640 1 Processor -- start 2024-05-10T03:54:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.338+0000 7f93e6996640 1 -- start start 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e6996640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93e00d21b0 0x7f93e00b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e6996640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93e00d2fe0 0x7f93e00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e6996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d3d20 0x7f93e00b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e6996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f93e00d0eb0 con 0x7f93e00d3d20 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e6996640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f93e00d0bd0 con 0x7f93e00d21b0 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e6996640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f93e00d02e0 con 0x7f93e00d2fe0 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d3d20 0x7f93e00b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d3d20 0x7f93e00b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38092/0 (socket says 172.21.15.55:38092) 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 -- 172.21.15.55:0/1345612884 learned_addr learned my addr 172.21.15.55:0/1345612884 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93df7fe640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93e00d2fe0 0x7f93e00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 -- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93e00d2fe0 msgr2=0x7f93e00b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93e00d2fe0 0x7f93e00b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 -- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93e00d21b0 msgr2=0x7f93e00b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93dffff640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93e00d21b0 0x7f93e00b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93e00d21b0 0x7f93e00b9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.339+0000 7f93e4f33640 1 -- 172.21.15.55:0/1345612884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e00babe0 con 0x7f93e00d3d20 2024-05-10T03:54:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.340+0000 7f93e4f33640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d3d20 0x7f93e00b3900 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c7a0 tx=0x7f93d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.340+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8018070 con 0x7f93e00d3d20 2024-05-10T03:54:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.340+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d800a5e0 con 0x7f93e00d3d20 2024-05-10T03:54:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.340+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e00b9b40 con 0x7f93e00d3d20 2024-05-10T03:54:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.340+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d800aa50 con 0x7f93e00d3d20 2024-05-10T03:54:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.340+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e00ba100 con 0x7f93e00d3d20 2024-05-10T03:54:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.341+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93e006a7e0 con 0x7f93e00d3d20 2024-05-10T03:54:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93d801b070 con 0x7f93e00d3d20 2024-05-10T03:54:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dcff9640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93cc0762d0 0x7f93cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f93d8096880 con 0x7f93e00d3d20 2024-05-10T03:54:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dffff640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93cc0762d0 0x7f93cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dcff9640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f93cc07c190 0x7f93cc07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 --> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93cc07ec60 con 0x7f93cc07c190 2024-05-10T03:54:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.342+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f93d809b2c0 con 0x7f93e00d3d20 2024-05-10T03:54:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.343+0000 7f93dffff640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93cc0762d0 0x7f93cc078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006fd0 tx=0x7f93d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.343+0000 7f93df7fe640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f93cc07c190 0x7f93cc07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.343+0000 7f93df7fe640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f93cc07c190 0x7f93cc07e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.344+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== osd.6 v2:172.21.15.64:6824/630497291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93cc07ec60 con 0x7f93cc07c190 2024-05-10T03:54:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.357+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 --> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f93e006ef60 con 0x7f93cc07c190 2024-05-10T03:54:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.357+0000 7f93dcff9640 1 -- 172.21.15.55:0/1345612884 <== osd.6 v2:172.21.15.64:6824/630497291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f93e006ef60 con 0x7f93cc07c190 2024-05-10T03:54:42.360 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:42.360 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:42.361 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f93cc07c190 msgr2=0x7f93cc07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.64:6824/630497291,v1:172.21.15.64:6825/630497291] conn(0x7f93cc07c190 0x7f93cc07e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93cc0762d0 msgr2=0x7f93cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f93cc0762d0 0x7f93cc078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f93d0006fd0 tx=0x7f93d0008040 comp rx=0 tx=0).stop 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d3d20 msgr2=0x7f93e00b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 --2- 172.21.15.55:0/1345612884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93e00d3d20 0x7f93e00b3900 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c7a0 tx=0x7f93d800cc60 comp rx=0 tx=0).stop 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e4f33640 1 -- 172.21.15.55:0/1345612884 reap_dead start 2024-05-10T03:54:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 shutdown_connections 2024-05-10T03:54:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 >> 172.21.15.55:0/1345612884 conn(0x7f93e009e540 msgr2=0x7f93e00b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 shutdown_connections 2024-05-10T03:54:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.358+0000 7f93e6996640 1 -- 172.21.15.55:0/1345612884 wait complete. 2024-05-10T03:54:42.371 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T03:54:42.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.473+0000 7fd12730a640 1 Processor -- start 2024-05-10T03:54:42.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.473+0000 7fd12730a640 1 -- start start 2024-05-10T03:54:42.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd12730a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd1200b44c0 0x7fd12009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd12730a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1200cd7d0 con 0x7fd1200b5660 2024-05-10T03:54:42.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd12730a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1200cdab0 con 0x7fd1200d2180 2024-05-10T03:54:42.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd12730a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd1200b48a0 con 0x7fd1200b44c0 2024-05-10T03:54:42.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd1248a5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1200b5660 0x7fd1200ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44238/0 (socket says 172.21.15.55:44238) 2024-05-10T03:54:42.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd1248a5640 1 -- 172.21.15.55:0/3296748988 learned_addr learned my addr 172.21.15.55:0/3296748988 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:42.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd1250a6640 1 --2- 172.21.15.55:0/3296748988 >> v2:172.21.15.64:3300/0 conn(0x7fd1200b44c0 0x7fd12009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd117fff640 1 -- 172.21.15.55:0/3296748988 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558256704 0 0) 0x7fd1200cd7d0 con 0x7fd1200b5660 2024-05-10T03:54:42.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.474+0000 7fd117fff640 1 -- 172.21.15.55:0/3296748988 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd10c003520 con 0x7fd1200b5660 2024-05-10T03:54:42.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.475+0000 7fd1250a6640 1 -- 172.21.15.55:0/3296748988 >> v1:172.21.15.64:6789/0 conn(0x7fd1200d2180 legacy=0x7fd1200ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.475+0000 7fd1250a6640 1 -- 172.21.15.55:0/3296748988 >> v1:172.21.15.55:6789/0 conn(0x7fd1200b5660 legacy=0x7fd1200ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.475+0000 7fd117fff640 1 -- 172.21.15.55:0/3296748988 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3870648052 0 0) 0x7fd10c003520 con 0x7fd1200b5660 2024-05-10T03:54:42.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.475+0000 7fd1250a6640 1 -- 172.21.15.55:0/3296748988 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1200cdd90 con 0x7fd1200b44c0 2024-05-10T03:54:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.475+0000 7fd1250a6640 1 --2- 172.21.15.55:0/3296748988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b44c0 0x7fd12009ba60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0097a0 tx=0x7fd11c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eccb3f9af45078d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd117fff640 1 -- 172.21.15.55:0/3296748988 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c037070 con 0x7fd1200b44c0 2024-05-10T03:54:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd117fff640 1 -- 172.21.15.55:0/3296748988 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c02abc0 con 0x7fd1200b44c0 2024-05-10T03:54:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd117fff640 1 -- 172.21.15.55:0/3296748988 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1100016f0 con 0x7fd1200b44c0 2024-05-10T03:54:42.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd12730a640 1 -- 172.21.15.55:0/3296748988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b44c0 msgr2=0x7fd12009ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd12730a640 1 --2- 172.21.15.55:0/3296748988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b44c0 0x7fd12009ba60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0097a0 tx=0x7fd11c02a130 comp rx=0 tx=0).stop 2024-05-10T03:54:42.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd12730a640 1 -- 172.21.15.55:0/3296748988 shutdown_connections 2024-05-10T03:54:42.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.476+0000 7fd12730a640 1 --2- 172.21.15.55:0/3296748988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b44c0 0x7fd12009ba60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.477+0000 7fd12730a640 1 -- 172.21.15.55:0/3296748988 >> 172.21.15.55:0/3296748988 conn(0x7fd1200b4b40 msgr2=0x7fd1200b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.477+0000 7fd12730a640 1 -- 172.21.15.55:0/3296748988 shutdown_connections 2024-05-10T03:54:42.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.477+0000 7fd12730a640 1 -- 172.21.15.55:0/3296748988 wait complete. 2024-05-10T03:54:42.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.478+0000 7fd12730a640 1 Processor -- start 2024-05-10T03:54:42.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.478+0000 7fd12730a640 1 -- start start 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.478+0000 7fd12730a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1200b44c0 0x7fd1201548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd12730a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b5660 0x7fd1201515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd12730a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 0x7fd1200c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd12730a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd12006e310 con 0x7fd1200d2180 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd12730a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd12006e6b0 con 0x7fd1200b5660 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd12730a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd12006e490 con 0x7fd1200b44c0 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 0x7fd1200c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 0x7fd1200c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38104/0 (socket says 172.21.15.55:38104) 2024-05-10T03:54:42.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 -- 172.21.15.55:0/491875020 learned_addr learned my addr 172.21.15.55:0/491875020 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1250a6640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1200b44c0 0x7fd1201548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1248a5640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b5660 0x7fd1201515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 -- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1200b44c0 msgr2=0x7fd1201548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1200b44c0 0x7fd1201548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 -- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b5660 msgr2=0x7fd1201515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b5660 0x7fd1201515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 -- 172.21.15.55:0/491875020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1200c7e60 con 0x7fd1200d2180 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1250a6640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1200b44c0 0x7fd1201548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T03:54:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd1258a7640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 0x7fd1200c8f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c7d0 tx=0x7fd11800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118003b70 con 0x7fd1200d2180 2024-05-10T03:54:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd118003d10 con 0x7fd1200d2180 2024-05-10T03:54:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1200c8140 con 0x7fd1200d2180 2024-05-10T03:54:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.479+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11800aa70 con 0x7fd1200d2180 2024-05-10T03:54:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.480+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1200c8700 con 0x7fd1200d2180 2024-05-10T03:54:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.481+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12006a7e0 con 0x7fd1200d2180 2024-05-10T03:54:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.481+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd11800ac10 con 0x7fd1200d2180 2024-05-10T03:54:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.482+0000 7fd115ffb640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd1040762d0 0x7fd104078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.482+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fd118097300 con 0x7fd1200d2180 2024-05-10T03:54:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.482+0000 7fd1250a6640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd1040762d0 0x7fd104078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.482+0000 7fd1250a6640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd1040762d0 0x7fd104078790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd11c034000 tx=0x7fd11c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.486+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd118060ec0 con 0x7fd1200d2180 2024-05-10T03:54:42.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.677+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd12015fa10 con 0x7fd1040762d0 2024-05-10T03:54:42.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.677+0000 7fd115ffb640 1 -- 172.21.15.55:0/491875020 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd12015fa10 con 0x7fd1040762d0 2024-05-10T03:54:42.681 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T03:54:42.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.679+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd1040762d0 msgr2=0x7fd104078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.679+0000 7fd12730a640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd1040762d0 0x7fd104078790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd11c034000 tx=0x7fd11c02e000 comp rx=0 tx=0).stop 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.679+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 msgr2=0x7fd1200c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.679+0000 7fd12730a640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 0x7fd1200c8f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c7d0 tx=0x7fd11800cc90 comp rx=0 tx=0).stop 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 shutdown_connections 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7fd1040762d0 0x7fd104078790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200d2180 0x7fd1200c8f00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1200b5660 0x7fd1201515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 --2- 172.21.15.55:0/491875020 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1200b44c0 0x7fd1201548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 >> 172.21.15.55:0/491875020 conn(0x7fd1200b4b40 msgr2=0x7fd1200b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 shutdown_connections 2024-05-10T03:54:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.680+0000 7fd12730a640 1 -- 172.21.15.55:0/491875020 wait complete. 2024-05-10T03:54:42.693 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T03:54:42.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T03:54:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.799+0000 7f0cc7c25640 1 Processor -- start 2024-05-10T03:54:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.799+0000 7f0cc7c25640 1 -- start start 2024-05-10T03:54:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc7c25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cc0145b30 0x7f0cc00d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc7c25640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc00b2b70 0x7f0cc00b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc7c25640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc0073180 con 0x7f0cc00723e0 2024-05-10T03:54:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc7c25640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc0072f60 con 0x7f0cc0145b30 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc7c25640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00b34f0 con 0x7f0cc00b2b70 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc59c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cc0145b30 0x7f0cc00d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc61c2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0cc00723e0 0x7f0cc0072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44252/0 (socket says 172.21.15.55:44252) 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc59c1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0cc0145b30 0x7f0cc00d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38106/0 (socket says 172.21.15.55:38106) 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc61c2640 1 -- 172.21.15.55:0/2794714928 learned_addr learned my addr 172.21.15.55:0/2794714928 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc51c0640 1 --2- 172.21.15.55:0/2794714928 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc00b2b70 0x7f0cc00b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc59c1640 1 -- 172.21.15.55:0/2794714928 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc00b2b70 msgr2=0x7f0cc00b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc59c1640 1 --2- 172.21.15.55:0/2794714928 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc00b2b70 0x7f0cc00b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc59c1640 1 -- 172.21.15.55:0/2794714928 >> v1:172.21.15.55:6789/0 conn(0x7f0cc00723e0 legacy=0x7f0cc0072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc49bf640 1 -- 172.21.15.55:0/2794714928 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074682091 0 0) 0x7f0cc0073180 con 0x7f0cc00723e0 2024-05-10T03:54:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.800+0000 7f0cc59c1640 1 -- 172.21.15.55:0/2794714928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00cf2e0 con 0x7f0cc0145b30 2024-05-10T03:54:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.801+0000 7f0cc59c1640 1 --2- 172.21.15.55:0/2794714928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0145b30 0x7f0cc00d00a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80097a0 tx=0x7f0cb802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995a77ea9f8653c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.801+0000 7f0cc49bf640 1 -- 172.21.15.55:0/2794714928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8037070 con 0x7f0cc0145b30 2024-05-10T03:54:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.801+0000 7f0cc49bf640 1 -- 172.21.15.55:0/2794714928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb802ae50 con 0x7f0cc0145b30 2024-05-10T03:54:42.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.801+0000 7f0cc49bf640 1 -- 172.21.15.55:0/2794714928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8032660 con 0x7f0cc0145b30 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.801+0000 7f0cc7c25640 1 -- 172.21.15.55:0/2794714928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0145b30 msgr2=0x7f0cc00d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 --2- 172.21.15.55:0/2794714928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0145b30 0x7f0cc00d00a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80097a0 tx=0x7f0cb802a100 comp rx=0 tx=0).stop 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 -- 172.21.15.55:0/2794714928 shutdown_connections 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 --2- 172.21.15.55:0/2794714928 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc00b2b70 0x7f0cc00b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 --2- 172.21.15.55:0/2794714928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc0145b30 0x7f0cc00d00a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 -- 172.21.15.55:0/2794714928 >> 172.21.15.55:0/2794714928 conn(0x7f0cc006f860 msgr2=0x7f0cc006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 -- 172.21.15.55:0/2794714928 shutdown_connections 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.802+0000 7f0cc7c25640 1 -- 172.21.15.55:0/2794714928 wait complete. 2024-05-10T03:54:42.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.803+0000 7f0cc7c25640 1 Processor -- start 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.803+0000 7f0cc7c25640 1 -- start start 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc7c25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc00723e0 0x7f0cc0141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc7c25640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc00b2b70 0x7f0cc0138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc7c25640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc0145b30 0x7f0cc0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc7c25640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00cfb80 con 0x7f0cc00723e0 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc7c25640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00cf8a0 con 0x7f0cc00b2b70 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc7c25640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00b3f90 con 0x7f0cc0145b30 2024-05-10T03:54:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc00723e0 0x7f0cc0141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc00723e0 0x7f0cc0141ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38112/0 (socket says 172.21.15.55:38112) 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 -- 172.21.15.55:0/650796096 learned_addr learned my addr 172.21.15.55:0/650796096 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc51c0640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc00b2b70 0x7f0cc0138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc61c2640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc0145b30 0x7f0cc0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 -- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc0145b30 msgr2=0x7f0cc0154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc0145b30 0x7f0cc0154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 -- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc00b2b70 msgr2=0x7f0cc0138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cc00b2b70 0x7f0cc0138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 -- 172.21.15.55:0/650796096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc01388c0 con 0x7f0cc00723e0 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc61c2640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0cc0145b30 0x7f0cc0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.804+0000 7f0cc59c1640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc00723e0 0x7f0cc0141ce0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80097a0 tx=0x7f0cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.805+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8042070 con 0x7f0cc00723e0 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.805+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb803e460 con 0x7f0cc00723e0 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.805+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8037040 con 0x7f0cc00723e0 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.805+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc014de10 con 0x7f0cc00723e0 2024-05-10T03:54:42.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.805+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc015e0a0 con 0x7f0cc00723e0 2024-05-10T03:54:42.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.805+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cc0142220 con 0x7f0cc00723e0 2024-05-10T03:54:42.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.806+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0cb8045070 con 0x7f0cc00723e0 2024-05-10T03:54:42.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cbe7fc640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0cac0762d0 0x7f0cac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f0cb80b7b80 con 0x7f0cc00723e0 2024-05-10T03:54:42.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cc51c0640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0cac0762d0 0x7f0cac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cbe7fc640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f0cac07c190 0x7f0cac07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 --> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cb8042e70 con 0x7f0cac07c190 2024-05-10T03:54:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0cb80bc2a0 con 0x7f0cc00723e0 2024-05-10T03:54:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cc61c2640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f0cac07c190 0x7f0cac07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.807+0000 7f0cc51c0640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0cac0762d0 0x7f0cac078790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0cc01525f0 tx=0x7f0cb400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.808+0000 7f0cc61c2640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f0cac07c190 0x7f0cac07e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.809+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== osd.7 v2:172.21.15.64:6800/767106247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cb8042e70 con 0x7f0cac07c190 2024-05-10T03:54:42.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.822+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 --> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0cc006a7e0 con 0x7f0cac07c190 2024-05-10T03:54:42.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.822+0000 7f0cbe7fc640 1 -- 172.21.15.55:0/650796096 <== osd.7 v2:172.21.15.64:6800/767106247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0cc006a7e0 con 0x7f0cac07c190 2024-05-10T03:54:42.825 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-10T03:54:42.826 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T03:54:42.826 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f0cac07c190 msgr2=0x7f0cac07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.64:6800/767106247,v1:172.21.15.64:6801/767106247] conn(0x7f0cac07c190 0x7f0cac07e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0cac0762d0 msgr2=0x7f0cac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f0cac0762d0 0x7f0cac078790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0cc01525f0 tx=0x7f0cb400b040 comp rx=0 tx=0).stop 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc00723e0 msgr2=0x7f0cc0141ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 --2- 172.21.15.55:0/650796096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cc00723e0 0x7f0cc0141ce0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80097a0 tx=0x7f0cb80046c0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc61c2640 1 -- 172.21.15.55:0/650796096 reap_dead start 2024-05-10T03:54:42.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 shutdown_connections 2024-05-10T03:54:42.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 >> 172.21.15.55:0/650796096 conn(0x7f0cc006f860 msgr2=0x7f0cc015fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 shutdown_connections 2024-05-10T03:54:42.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.823+0000 7f0cc7c25640 1 -- 172.21.15.55:0/650796096 wait complete. 2024-05-10T03:54:42.836 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T03:54:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.939+0000 7f1ee7924640 1 Processor -- start 2024-05-10T03:54:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.939+0000 7f1ee7924640 1 -- start start 2024-05-10T03:54:42.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee7924640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1ee00712c0 0x7f1ee0160110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee7924640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 0x7f1ee006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee7924640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee015f930 con 0x7f1ee015cca0 2024-05-10T03:54:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee7924640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee015fc80 con 0x7f1ee00712c0 2024-05-10T03:54:42.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee7924640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee0163690 con 0x7f1ee006c390 2024-05-10T03:54:42.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee4ebf640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1ee00712c0 0x7f1ee0160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee5ec1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 0x7f1ee006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee56c0640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1ee015cca0 0x7f1ee0162eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49108/0 (socket says 172.21.15.55:49108) 2024-05-10T03:54:42.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee56c0640 1 -- 172.21.15.55:0/285815329 learned_addr learned my addr 172.21.15.55:0/285815329 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.940+0000 7f1ee5ec1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 0x7f1ee006c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.55:46964/0 (socket says 172.21.15.55:46964) 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ed7fff640 1 -- 172.21.15.55:0/285815329 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241186134 0 0) 0x7f1ee015f930 con 0x7f1ee015cca0 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ed7fff640 1 -- 172.21.15.55:0/285815329 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ecc003520 con 0x7f1ee015cca0 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/285815329 >> v2:172.21.15.64:3300/0 conn(0x7f1ee00712c0 msgr2=0x7f1ee0160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ee5ec1640 1 --2- 172.21.15.55:0/285815329 >> v2:172.21.15.64:3300/0 conn(0x7f1ee00712c0 0x7f1ee0160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/285815329 >> v1:172.21.15.64:6789/0 conn(0x7f1ee015cca0 legacy=0x7f1ee0162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/285815329 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee0163970 con 0x7f1ee006c390 2024-05-10T03:54:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ee4ebf640 1 --2- 172.21.15.55:0/285815329 >> v2:172.21.15.64:3300/0 conn(0x7f1ee00712c0 0x7f1ee0160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.941+0000 7f1ee5ec1640 1 --2- 172.21.15.55:0/285815329 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 0x7f1ee006c820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009d90 tx=0x7f1ed802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a1b268090b9296 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ed7fff640 1 -- 172.21.15.55:0/285815329 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8007740 con 0x7f1ee006c390 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ed7fff640 1 -- 172.21.15.55:0/285815329 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed80078e0 con 0x7f1ee006c390 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ed7fff640 1 -- 172.21.15.55:0/285815329 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8007c90 con 0x7f1ee006c390 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 -- 172.21.15.55:0/285815329 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 msgr2=0x7f1ee006c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 --2- 172.21.15.55:0/285815329 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 0x7f1ee006c820 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009d90 tx=0x7f1ed802a660 comp rx=0 tx=0).stop 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 -- 172.21.15.55:0/285815329 shutdown_connections 2024-05-10T03:54:42.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 --2- 172.21.15.55:0/285815329 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee006c390 0x7f1ee006c820 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 --2- 172.21.15.55:0/285815329 >> v2:172.21.15.64:3300/0 conn(0x7f1ee00712c0 0x7f1ee0160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 -- 172.21.15.55:0/285815329 >> 172.21.15.55:0/285815329 conn(0x7f1ee006ddc0 msgr2=0x7f1ee00b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 -- 172.21.15.55:0/285815329 shutdown_connections 2024-05-10T03:54:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.942+0000 7f1ee7924640 1 -- 172.21.15.55:0/285815329 wait complete. 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 Processor -- start 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 -- start start 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ee006c390 0x7f1ee0161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee00712c0 0x7f1ee00c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 0x7f1ee01f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee01607d0 con 0x7f1ee015cca0 2024-05-10T03:54:42.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee0160650 con 0x7f1ee006c390 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.944+0000 7f1ee7924640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee015d080 con 0x7f1ee00712c0 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 0x7f1ee01f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 0x7f1ee01f8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38124/0 (socket says 172.21.15.55:38124) 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/3691753 learned_addr learned my addr 172.21.15.55:0/3691753 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee4ebf640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee00712c0 0x7f1ee00c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee56c0640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ee006c390 0x7f1ee0161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee00712c0 msgr2=0x7f1ee00c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee00712c0 0x7f1ee00c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ee006c390 msgr2=0x7f1ee0161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ee006c390 0x7f1ee0161ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 -- 172.21.15.55:0/3691753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00c8350 con 0x7f1ee015cca0 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee5ec1640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 0x7f1ee01f8020 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009eb0 tx=0x7f1ed8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8009450 con 0x7f1ee015cca0 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed8004240 con 0x7f1ee015cca0 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee00c8630 con 0x7f1ee015cca0 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.945+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8004630 con 0x7f1ee015cca0 2024-05-10T03:54:42.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.946+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee00c8bf0 con 0x7f1ee015cca0 2024-05-10T03:54:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.947+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee006a7e0 con 0x7f1ee015cca0 2024-05-10T03:54:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.947+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ed803b410 con 0x7f1ee015cca0 2024-05-10T03:54:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.948+0000 7f1ed5ffb640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ec40762d0 0x7f1ec4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.948+0000 7f1ee56c0640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ec40762d0 0x7f1ec4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.948+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f1ed80b8270 con 0x7f1ee015cca0 2024-05-10T03:54:42.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.948+0000 7f1ee56c0640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ec40762d0 0x7f1ec4078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007a60 tx=0x7f1edc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:42.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:42.952+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ed803f030 con 0x7f1ee015cca0 2024-05-10T03:54:43.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.145+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f1ee00b61e0 con 0x7f1ec40762d0 2024-05-10T03:54:43.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.145+0000 7f1ed5ffb640 1 -- 172.21.15.55:0/3691753 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1ee00b61e0 con 0x7f1ec40762d0 2024-05-10T03:54:43.148 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T03:54:43.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ec40762d0 msgr2=0x7f1ec4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ec40762d0 0x7f1ec4078790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1edc007a60 tx=0x7f1edc009040 comp rx=0 tx=0).stop 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 msgr2=0x7f1ee01f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 0x7f1ee01f8020 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009eb0 tx=0x7f1ed8004a40 comp rx=0 tx=0).stop 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 shutdown_connections 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f1ec40762d0 0x7f1ec4078790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ee015cca0 0x7f1ee01f8020 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ee00712c0 0x7f1ee00c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 --2- 172.21.15.55:0/3691753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ee006c390 0x7f1ee0161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 >> 172.21.15.55:0/3691753 conn(0x7f1ee006ddc0 msgr2=0x7f1ee015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 shutdown_connections 2024-05-10T03:54:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.147+0000 7f1ee7924640 1 -- 172.21.15.55:0/3691753 wait complete. 2024-05-10T03:54:43.161 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:54:43.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.262+0000 7f2857d51640 1 Processor -- start 2024-05-10T03:54:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.263+0000 7f2857d51640 1 -- start start 2024-05-10T03:54:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.263+0000 7f2857d51640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f285015f3d0 0x7f28500d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.263+0000 7f2857d51640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28500d2980 0x7f28500d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.263+0000 7f2857d51640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2850160a10 con 0x7f28500d3360 2024-05-10T03:54:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.263+0000 7f2857d51640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2850160450 con 0x7f28500d2980 2024-05-10T03:54:43.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.263+0000 7f2857d51640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2850160730 con 0x7f285015f3d0 2024-05-10T03:54:43.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f28552ec640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28500d2980 0x7f28500d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:43.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2855aed640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f285015f3d0 0x7f28500d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:43.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f28562ee640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f28500d3360 0x7f28500b4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.55:49120/0 (socket says 172.21.15.55:49120) 2024-05-10T03:54:43.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f28562ee640 1 -- 172.21.15.55:0/2895478079 learned_addr learned my addr 172.21.15.55:0/2895478079 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:54:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2854aeb640 1 -- 172.21.15.55:0/2895478079 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232059529 0 0) 0x7f2850160a10 con 0x7f28500d3360 2024-05-10T03:54:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2854aeb640 1 -- 172.21.15.55:0/2895478079 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f283c003520 con 0x7f28500d3360 2024-05-10T03:54:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2855aed640 1 -- 172.21.15.55:0/2895478079 >> v2:172.21.15.64:3300/0 conn(0x7f28500d2980 msgr2=0x7f28500d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:54:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2855aed640 1 --2- 172.21.15.55:0/2895478079 >> v2:172.21.15.64:3300/0 conn(0x7f28500d2980 0x7f28500d38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2855aed640 1 -- 172.21.15.55:0/2895478079 >> v1:172.21.15.64:6789/0 conn(0x7f28500d3360 legacy=0x7f28500b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.264+0000 7f2855aed640 1 -- 172.21.15.55:0/2895478079 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500d1c40 con 0x7f285015f3d0 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.265+0000 7f2855aed640 1 --2- 172.21.15.55:0/2895478079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f285015f3d0 0x7f28500d2440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f284c0097a0 tx=0x7f284c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d03e2556029f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.265+0000 7f2854aeb640 1 -- 172.21.15.55:0/2895478079 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c037070 con 0x7f285015f3d0 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.265+0000 7f2854aeb640 1 -- 172.21.15.55:0/2895478079 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c02ae50 con 0x7f285015f3d0 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2854aeb640 1 -- 172.21.15.55:0/2895478079 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c032640 con 0x7f285015f3d0 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 -- 172.21.15.55:0/2895478079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f285015f3d0 msgr2=0x7f28500d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 --2- 172.21.15.55:0/2895478079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f285015f3d0 0x7f28500d2440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f284c0097a0 tx=0x7f284c02a100 comp rx=0 tx=0).stop 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 -- 172.21.15.55:0/2895478079 shutdown_connections 2024-05-10T03:54:43.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 --2- 172.21.15.55:0/2895478079 >> v2:172.21.15.64:3300/0 conn(0x7f28500d2980 0x7f28500d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 --2- 172.21.15.55:0/2895478079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f285015f3d0 0x7f28500d2440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 -- 172.21.15.55:0/2895478079 >> 172.21.15.55:0/2895478079 conn(0x7f285008ed00 msgr2=0x7f285009e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 -- 172.21.15.55:0/2895478079 shutdown_connections 2024-05-10T03:54:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.266+0000 7f2857d51640 1 -- 172.21.15.55:0/2895478079 wait complete. 2024-05-10T03:54:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.267+0000 7f2857d51640 1 Processor -- start 2024-05-10T03:54:43.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.267+0000 7f2857d51640 1 -- start start 2024-05-10T03:54:43.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2857d51640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28500d3360 0x7f28501538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2857d51640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 0x7f28500cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2857d51640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28500cc8f0 0x7f285015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2857d51640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f28500b57f0 con 0x7f285015f3d0 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2857d51640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f28500b5670 con 0x7f28500cc8f0 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2857d51640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f28501f6cd0 con 0x7f28500d3360 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f28552ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 0x7f28500cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f28552ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 0x7f28500cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38126/0 (socket says 172.21.15.55:38126) 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f28552ec640 1 -- 172.21.15.55:0/1555179762 learned_addr learned my addr 172.21.15.55:0/1555179762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:54:43.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.268+0000 7f2855aed640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28500d3360 0x7f28501538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28562ee640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28500cc8f0 0x7f285015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28552ec640 1 -- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28500d3360 msgr2=0x7f28501538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28552ec640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28500d3360 0x7f28501538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28552ec640 1 -- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28500cc8f0 msgr2=0x7f285015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28552ec640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28500cc8f0 0x7f285015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28552ec640 1 -- 172.21.15.55:0/1555179762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500cce70 con 0x7f285015f3d0 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28562ee640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28500cc8f0 0x7f285015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:54:43.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28552ec640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 0x7f28500cc3b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f284000e870 tx=0x7f284000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840017070 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284000c8e0 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28500cd150 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284000ccd0 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.269+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28500cd710 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.270+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28500a3290 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.271+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f284001a070 con 0x7f285015f3d0 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.272+0000 7f28467fc640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2834076300 0x7f28340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:54:43.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.272+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f2840096fe0 con 0x7f285015f3d0 2024-05-10T03:54:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.272+0000 7f2855aed640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2834076300 0x7f28340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:54:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.272+0000 7f2855aed640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2834076300 0x7f28340787c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f284c034000 tx=0x7f284c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:54:43.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.276+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2840060600 con 0x7f285015f3d0 2024-05-10T03:54:43.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.462+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28500b67f0 con 0x7f2834076300 2024-05-10T03:54:43.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.463+0000 7f28467fc640 1 -- 172.21.15.55:0/1555179762 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7f28500b67f0 con 0x7f2834076300 2024-05-10T03:54:43.466 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:54:43.466 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:54:43.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2834076300 msgr2=0x7f28340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2834076300 0x7f28340787c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f284c034000 tx=0x7f284c02e000 comp rx=0 tx=0).stop 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 msgr2=0x7f28500cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 0x7f28500cc3b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f284000e870 tx=0x7f284000ed30 comp rx=0 tx=0).stop 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 shutdown_connections 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28500cc8f0 0x7f285015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f2834076300 0x7f28340787c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f285015f3d0 0x7f28500cc3b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.465+0000 7f2857d51640 1 --2- 172.21.15.55:0/1555179762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28500d3360 0x7f28501538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:54:43.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.466+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 >> 172.21.15.55:0/1555179762 conn(0x7f285008ed00 msgr2=0x7f285006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:54:43.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.466+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 shutdown_connections 2024-05-10T03:54:43.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:54:43.466+0000 7f2857d51640 1 -- 172.21.15.55:0/1555179762 wait complete. 2024-05-10T03:54:43.479 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-05-10T03:54:41.793111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237064,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737656,"statfs":{"total":773094113280,"available":772851359744,"internally_reserved":0,"allocated":4333568,"data_stored":2391848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14772,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-11,"num_read_kb":-12,"num_write":-75,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001476"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T03:54:34.928087+0000","last_change":"2024-05-10T03:53:35.870269+0000","last_active":"2024-05-10T03:54:34.928087+0000","last_peered":"2024-05-10T03:54:34.928087+0000","last_clean":"2024-05-10T03:54:34.928087+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:34.928087+0000","last_undegraded":"2024-05-10T03:54:34.928087+0000","last_fullsized":"2024-05-10T03:54:34.928087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T03:53:34.221766+0000","last_clean_scrub_stamp":"2024-05-10T03:53:34.221766+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:37:47.579390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:54:43.481 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T03:53:34.221766+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=3, tm_min=53, tm_sec=34, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=3, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T03:54:43.482 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T03:55:03.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T03:55:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.598+0000 7f8b7f9f0640 1 Processor -- start 2024-05-10T03:55:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.598+0000 7f8b7f9f0640 1 -- start start 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7f9f0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8b78141c50 0x7f8b780cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7f9f0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b78072cf0 con 0x7f8b780cf680 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7f9f0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b78072fd0 con 0x7f8b7815b880 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7f9f0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f8b780732b0 con 0x7f8b78141c50 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7df8d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b780cf680 0x7f8b78073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40640/0 (socket says 172.21.15.55:40640) 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7df8d640 1 -- 172.21.15.55:0/376858016 learned_addr learned my addr 172.21.15.55:0/376858016 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:55:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/376858016 >> v2:172.21.15.64:3300/0 conn(0x7f8b78141c50 0x7f8b780cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993215746 0 0) 0x7f8b78072cf0 con 0x7f8b780cf680 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.599+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b64003520 con 0x7f8b780cf680 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2329233257 0 0) 0x7f8b64003520 con 0x7f8b780cf680 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 >> v2:172.21.15.64:3300/0 conn(0x7f8b78141c50 msgr2=0x7f8b780cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 --2- 172.21.15.55:0/376858016 >> v2:172.21.15.64:3300/0 conn(0x7f8b78141c50 0x7f8b780cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 >> v1:172.21.15.64:6789/0 conn(0x7f8b7815b880 legacy=0x7f8b780b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b78073590 con 0x7f8b780cf680 2024-05-10T03:55:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 300630594 0 0) 0x7f8b70001a70 con 0x7f8b780cf680 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/376858016 >> v2:172.21.15.64:3300/0 conn(0x7f8b78141c50 0x7f8b780cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 >> v1:172.21.15.55:6789/0 conn(0x7f8b780cf680 legacy=0x7f8b78073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b64003a50 0x7f8b64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b64004800 0x7f8b64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640052e0 0x7f8b64005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780732b0 con 0x7f8b640052e0 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64006270 con 0x7f8b64003a50 2024-05-10T03:55:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8b64006470 con 0x7f8b64004800 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7df8d640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640052e0 0x7f8b64005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7d78c640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b64003a50 0x7f8b64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b64004800 0x7f8b64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7df8d640 1 -- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b64004800 msgr2=0x7f8b64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7df8d640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b64004800 0x7f8b64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7df8d640 1 -- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b64003a50 msgr2=0x7f8b64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7df8d640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b64003a50 0x7f8b64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7df8d640 1 -- 172.21.15.55:0/376858016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b64003520 con 0x7f8b640052e0 2024-05-10T03:55:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.600+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b64004800 0x7f8b64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:55:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.601+0000 7f8b7df8d640 1 -- 172.21.15.55:0/376858016 reap_dead start 2024-05-10T03:55:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.601+0000 7f8b7df8d640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640052e0 0x7f8b64005990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000a880 tx=0x7f8b64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c98e129bf6b5c31 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.601+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000a4d0 con 0x7f8b640052e0 2024-05-10T03:55:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.601+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7002f070 con 0x7f8b640052e0 2024-05-10T03:55:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.601+0000 7f8b6ffff640 1 -- 172.21.15.55:0/376858016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7002bbf0 con 0x7f8b640052e0 2024-05-10T03:55:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/376858016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640052e0 msgr2=0x7f8b64005990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640052e0 0x7f8b64005990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000a880 tx=0x7f8b64005830 comp rx=0 tx=0).stop 2024-05-10T03:55:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/376858016 shutdown_connections 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/376858016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b640052e0 0x7f8b64005990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/376858016 >> 172.21.15.55:0/376858016 conn(0x7f8b780b2cc0 msgr2=0x7f8b780b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/376858016 shutdown_connections 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.602+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/376858016 wait complete. 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.603+0000 7f8b7f9f0640 1 Processor -- start 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.603+0000 7f8b7f9f0640 1 -- start start 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7f9f0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b640052e0 0x7f8b7813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7f9f0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 0x7f8b78156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7f9f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b7813e100 0x7f8b7815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7f9f0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780cf4d0 con 0x7f8b781f54d0 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7f9f0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780cf350 con 0x7f8b7813e100 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7f9f0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8b780b6920 con 0x7f8b640052e0 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 0x7f8b78156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 0x7f8b78156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39842/0 (socket says 172.21.15.55:39842) 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 -- 172.21.15.55:0/3963944859 learned_addr learned my addr 172.21.15.55:0/3963944859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:55:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7d78c640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b640052e0 0x7f8b7813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7df8d640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b7813e100 0x7f8b7815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 -- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b640052e0 msgr2=0x7f8b7813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b640052e0 0x7f8b7813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 -- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b7813e100 msgr2=0x7f8b7815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b7813e100 0x7f8b7815a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.604+0000 7f8b7cf8b640 1 -- 172.21.15.55:0/3963944859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7813ea70 con 0x7f8b781f54d0 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.605+0000 7f8b7cf8b640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 0x7f8b78156af0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8b680118d0 tx=0x7f8b68011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.605+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6800fbd0 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.605+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6800fd70 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.605+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68015660 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.605+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7813ed50 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.605+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7813f310 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.606+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b78074110 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.607+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b68015800 con 0x7f8b781f54d0 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.607+0000 7f8b6dffb640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8b5c076300 0x7f8b5c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.607+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f8b68097b60 con 0x7f8b781f54d0 2024-05-10T03:55:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.608+0000 7f8b7d78c640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8b5c076300 0x7f8b5c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.608+0000 7f8b7d78c640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8b5c076300 0x7f8b5c0787c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b740017a0 tx=0x7f8b74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.612+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8b68019030 con 0x7f8b781f54d0 2024-05-10T03:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.800+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 --> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b78050820 con 0x7f8b5c076300 2024-05-10T03:55:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.801+0000 7f8b6dffb640 1 -- 172.21.15.55:0/3963944859 <== mgr.4104 v2:172.21.15.55:6832/2693796855 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13339 (secure 0 0 0) 0x7f8b78050820 con 0x7f8b5c076300 2024-05-10T03:55:03.804 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:55:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8b5c076300 msgr2=0x7f8b5c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8b5c076300 0x7f8b5c0787c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8b740017a0 tx=0x7f8b74009040 comp rx=0 tx=0).stop 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 msgr2=0x7f8b78156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 0x7f8b78156af0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8b680118d0 tx=0x7f8b68011d90 comp rx=0 tx=0).stop 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 shutdown_connections 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b7813e100 0x7f8b7815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f8b5c076300 0x7f8b5c0787c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b781f54d0 0x7f8b78156af0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 --2- 172.21.15.55:0/3963944859 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8b640052e0 0x7f8b7813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 >> 172.21.15.55:0/3963944859 conn(0x7f8b780b2cc0 msgr2=0x7f8b78141030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:55:03.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 shutdown_connections 2024-05-10T03:55:03.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.803+0000 7f8b7f9f0640 1 -- 172.21.15.55:0/3963944859 wait complete. 2024-05-10T03:55:03.816 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-10T03:55:03.796759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":237048,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737672,"statfs":{"total":773094113280,"available":772851376128,"internally_reserved":0,"allocated":4333568,"data_stored":2391848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001911"},"pg_stats":[{"pgid":"1.0","version":"34'74","reported_seq":143,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T03:54:44.086471+0000","last_change":"2024-05-10T03:54:44.086511+0000","last_active":"2024-05-10T03:54:44.086471+0000","last_peered":"2024-05-10T03:54:44.086471+0000","last_clean":"2024-05-10T03:54:44.086471+0000","last_became_active":"2024-05-10T03:53:35.867476+0000","last_became_peered":"2024-05-10T03:53:35.867476+0000","last_unstale":"2024-05-10T03:54:44.086471+0000","last_undegraded":"2024-05-10T03:54:44.086471+0000","last_fullsized":"2024-05-10T03:54:44.086471+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-05-10T03:54:44.086375+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-05-10T03:54:44.086375+0000","last_clean_scrub_stamp":"2024-05-10T03:54:44.086375+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:38.297082+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":151389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":987136,"data_stored":741757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T03:55:03.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T03:55:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.919+0000 7f3e30971640 1 Processor -- start 2024-05-10T03:55:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.919+0000 7f3e30971640 1 -- start start 2024-05-10T03:55:03.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e30971640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e2c0b4ad0 0x7f3e2c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e30971640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3e2c0b5300 0x7f3e2c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e30971640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2c0b5c40 con 0x7f3e2c15ccc0 2024-05-10T03:55:03.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e30971640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2c0b3830 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e30971640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2c0b32f0 con 0x7f3e2c0b5300 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e2c0b4ad0 0x7f3e2c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e2c0b4ad0 0x7f3e2c15d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39844/0 (socket says 172.21.15.55:39844) 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 -- 172.21.15.55:0/191818994 learned_addr learned my addr 172.21.15.55:0/191818994 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e2ad9d640 1 --2- 172.21.15.55:0/191818994 >> v2:172.21.15.64:3300/0 conn(0x7f3e2c0b5300 0x7f3e2c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 -- 172.21.15.55:0/191818994 >> v2:172.21.15.64:3300/0 conn(0x7f3e2c0b5300 msgr2=0x7f3e2c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 --2- 172.21.15.55:0/191818994 >> v2:172.21.15.64:3300/0 conn(0x7f3e2c0b5300 0x7f3e2c0b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 -- 172.21.15.55:0/191818994 >> v1:172.21.15.64:6789/0 conn(0x7f3e2c15ccc0 legacy=0x7f3e2c0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.920+0000 7f3e23fff640 1 -- 172.21.15.55:0/191818994 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c0b3550 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.921+0000 7f3e23fff640 1 --2- 172.21.15.55:0/191818994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c15d0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c073950 tx=0x7f3e1402c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52375c5a187764b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.921+0000 7f3e29d9b640 1 -- 172.21.15.55:0/191818994 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14038070 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.921+0000 7f3e29d9b640 1 -- 172.21.15.55:0/191818994 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14031710 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.921+0000 7f3e29d9b640 1 -- 172.21.15.55:0/191818994 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14031ae0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 -- 172.21.15.55:0/191818994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 msgr2=0x7f3e2c15d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 --2- 172.21.15.55:0/191818994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c15d0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c073950 tx=0x7f3e1402c480 comp rx=0 tx=0).stop 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 -- 172.21.15.55:0/191818994 shutdown_connections 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 --2- 172.21.15.55:0/191818994 >> v2:172.21.15.64:3300/0 conn(0x7f3e2c0b5300 0x7f3e2c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 --2- 172.21.15.55:0/191818994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c15d0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 -- 172.21.15.55:0/191818994 >> 172.21.15.55:0/191818994 conn(0x7f3e2c06c390 msgr2=0x7f3e2c06c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 -- 172.21.15.55:0/191818994 shutdown_connections 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.922+0000 7f3e30971640 1 -- 172.21.15.55:0/191818994 wait complete. 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.923+0000 7f3e30971640 1 Processor -- start 2024-05-10T03:55:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.923+0000 7f3e30971640 1 -- start start 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e30971640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e30971640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e2c0b5300 0x7f3e2c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e30971640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e2c15ccc0 0x7f3e2c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e30971640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c0b42d0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e30971640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c15d5e0 con 0x7f3e2c0b5300 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e30971640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2c0b45b0 con 0x7f3e2c15ccc0 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39846/0 (socket says 172.21.15.55:39846) 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 -- 172.21.15.55:0/2112682027 learned_addr learned my addr 172.21.15.55:0/2112682027 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e23fff640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e2c0b5300 0x7f3e2c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2ad9d640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e2c15ccc0 0x7f3e2c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 -- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e2c15ccc0 msgr2=0x7f3e2c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e2c15ccc0 0x7f3e2c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 -- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e2c0b5300 msgr2=0x7f3e2c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e2c0b5300 0x7f3e2c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 -- 172.21.15.55:0/2112682027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c1430e0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e23fff640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e2c0b5300 0x7f3e2c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e2a59c640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c146380 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c3a0 tx=0x7f3e1c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.924+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c017070 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.925+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0052d0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.925+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c1433c0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.925+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003830 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.925+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c143980 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.925+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2c0cddb0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.926+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e1c01a070 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.927+0000 7f3e22ffd640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e0c0762d0 0x7f3e0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.927+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f3e1c096660 con 0x7f3e2c0b4ad0 2024-05-10T03:55:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.927+0000 7f3e23fff640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e0c0762d0 0x7f3e0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.927+0000 7f3e23fff640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e0c0762d0 0x7f3e0c078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e14035000 tx=0x7f3e14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:03.931+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3e2c0cddb0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:04.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.122+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3e2c06a7e0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:04.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.129+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f3e1c0602c0 con 0x7f3e2c0b4ad0 2024-05-10T03:55:04.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.131+0000 7f3e22ffd640 1 -- 172.21.15.55:0/2112682027 <== mon.0 v2:172.21.15.55:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3e1c005480 con 0x7f3e2c0b4ad0 2024-05-10T03:55:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e0c0762d0 msgr2=0x7f3e0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e0c0762d0 0x7f3e0c078790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e14035000 tx=0x7f3e14008030 comp rx=0 tx=0).stop 2024-05-10T03:55:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 msgr2=0x7f3e2c146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c146380 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c3a0 tx=0x7f3e1c00c860 comp rx=0 tx=0).stop 2024-05-10T03:55:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 shutdown_connections 2024-05-10T03:55:04.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e2c15ccc0 0x7f3e2c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e2c0b5300 0x7f3e2c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f3e0c0762d0 0x7f3e0c078790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 --2- 172.21.15.55:0/2112682027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e2c0b4ad0 0x7f3e2c146380 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 >> 172.21.15.55:0/2112682027 conn(0x7f3e2c06c390 msgr2=0x7f3e2c154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:55:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 shutdown_connections 2024-05-10T03:55:04.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.132+0000 7f3e30971640 1 -- 172.21.15.55:0/2112682027 wait complete. 2024-05-10T03:55:04.146 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T03:55:04.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T03:55:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.248+0000 7f8569d4e640 1 Processor -- start 2024-05-10T03:55:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.248+0000 7f8569d4e640 1 -- start start 2024-05-10T03:55:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.248+0000 7f8569d4e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85640d3360 0x7f85640d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.248+0000 7f8569d4e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85640d2b50 con 0x7f856415f3d0 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.248+0000 7f8569d4e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564160a10 con 0x7f85640d3de0 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.248+0000 7f8569d4e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f85640d4210 con 0x7f85640d3360 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f8562ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85640d3360 0x7f85640d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f85637fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f856415f3d0 0x7f85640d2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40642/0 (socket says 172.21.15.55:40642) 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f85637fe640 1 -- 172.21.15.55:0/3109738730 learned_addr learned my addr 172.21.15.55:0/3109738730 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f8562ffd640 1 -- 172.21.15.55:0/3109738730 >> v1:172.21.15.64:6789/0 conn(0x7f85640d3de0 legacy=0x7f85640b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f8562ffd640 1 -- 172.21.15.55:0/3109738730 >> v1:172.21.15.55:6789/0 conn(0x7f856415f3d0 legacy=0x7f85640d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f8562ffd640 1 -- 172.21.15.55:0/3109738730 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8564160450 con 0x7f85640d3360 2024-05-10T03:55:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.249+0000 7f85627fc640 1 -- 172.21.15.55:0/3109738730 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625717234 0 0) 0x7f85640d2b50 con 0x7f856415f3d0 2024-05-10T03:55:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8562ffd640 1 --2- 172.21.15.55:0/3109738730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3360 0x7f85640d38a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f85580097a0 tx=0x7f855802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc5d7f558b47440 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f85627fc640 1 -- 172.21.15.55:0/3109738730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558037070 con 0x7f85640d3360 2024-05-10T03:55:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f85627fc640 1 -- 172.21.15.55:0/3109738730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8558032440 con 0x7f85640d3360 2024-05-10T03:55:04.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f85627fc640 1 -- 172.21.15.55:0/3109738730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558032830 con 0x7f85640d3360 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 -- 172.21.15.55:0/3109738730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3360 msgr2=0x7f85640d38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3109738730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3360 0x7f85640d38a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f85580097a0 tx=0x7f855802a180 comp rx=0 tx=0).stop 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 -- 172.21.15.55:0/3109738730 shutdown_connections 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3109738730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3360 0x7f85640d38a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 -- 172.21.15.55:0/3109738730 >> 172.21.15.55:0/3109738730 conn(0x7f856408ed00 msgr2=0x7f856409e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 -- 172.21.15.55:0/3109738730 shutdown_connections 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.250+0000 7f8569d4e640 1 -- 172.21.15.55:0/3109738730 wait complete. 2024-05-10T03:55:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.252+0000 7f8569d4e640 1 Processor -- start 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.252+0000 7f8569d4e640 1 -- start start 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.252+0000 7f8569d4e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85640d3360 0x7f85640c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 0x7f85641f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f856415f3d0 0x7f85640cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f85640d1f20 con 0x7f85640d3de0 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f85640d1c40 con 0x7f85640d3360 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f85640b5670 con 0x7f856415f3d0 2024-05-10T03:55:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 0x7f85641f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 0x7f85641f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39862/0 (socket says 172.21.15.55:39862) 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 -- 172.21.15.55:0/3773574318 learned_addr learned my addr 172.21.15.55:0/3773574318 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8563fff640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f856415f3d0 0x7f85640cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f85637fe640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85640d3360 0x7f85640c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 -- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f856415f3d0 msgr2=0x7f85640cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f856415f3d0 0x7f85640cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 -- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85640d3360 msgr2=0x7f85640c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85640d3360 0x7f85640c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 -- 172.21.15.55:0/3773574318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85640cb4e0 con 0x7f85640d3de0 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8562ffd640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 0x7f85641f5590 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8558000c00 tx=0x7f85580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558037050 con 0x7f85640d3de0 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8558038040 con 0x7f85640d3de0 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558004490 con 0x7f85640d3de0 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85640c8f40 con 0x7f85640d3de0 2024-05-10T03:55:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.253+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85640c9500 con 0x7f85640d3de0 2024-05-10T03:55:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.254+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85640a3290 con 0x7f85640d3de0 2024-05-10T03:55:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.255+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8558030980 con 0x7f85640d3de0 2024-05-10T03:55:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.256+0000 7f854bfff640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f85500762d0 0x7f8550078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T03:55:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.256+0000 7f85637fe640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f85500762d0 0x7f8550078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T03:55:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.256+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f85580b8160 con 0x7f85640d3de0 2024-05-10T03:55:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.256+0000 7f85637fe640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f85500762d0 0x7f8550078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8554000f60 tx=0x7f8554007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T03:55:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.260+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8558030c70 con 0x7f85640d3de0 2024-05-10T03:55:04.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.490+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85640b67f0 con 0x7f85640d3de0 2024-05-10T03:55:04.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.490+0000 7f854bfff640 1 -- 172.21.15.55:0/3773574318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3860 (secure 0 0 0) 0x7f8558081d20 con 0x7f85640d3de0 2024-05-10T03:55:04.493 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-10T03:55:04.493 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/57320813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6833","nonce":57320813},{"type":"v1","addr":"172.21.15.64:6835","nonce":57320813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/2580257083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":2580257083},{"type":"v1","addr":"172.21.15.55:6837","nonce":2580257083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4633,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6834/1959364805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":1959364805},{"type":"v1","addr":"172.21.15.64:6834","nonce":1959364805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5061,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/401830949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":401830949},{"type":"v1","addr":"172.21.15.55:6836","nonce":401830949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-05-10T03:55:04.494 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 21 2024-05-10T03:55:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f85500762d0 msgr2=0x7f8550078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f85500762d0 0x7f8550078790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8554000f60 tx=0x7f8554007c00 comp rx=0 tx=0).stop 2024-05-10T03:55:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 msgr2=0x7f85641f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T03:55:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 0x7f85641f5590 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8558000c00 tx=0x7f85580046c0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 shutdown_connections 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f856415f3d0 0x7f85640cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:6832/2693796855,v1:172.21.15.55:6833/2693796855] conn(0x7f85500762d0 0x7f8550078790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85640d3de0 0x7f85641f5590 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 --2- 172.21.15.55:0/3773574318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f85640d3360 0x7f85640c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 >> 172.21.15.55:0/3773574318 conn(0x7f856408ed00 msgr2=0x7f85640b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 shutdown_connections 2024-05-10T03:55:04.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-10T03:55:04.492+0000 7f8569d4e640 1 -- 172.21.15.55:0/3773574318 wait complete. 2024-05-10T03:55:04.506 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-10T03:55:04.506 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T03:55:04.507 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T03:55:04.507 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.516 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T03:55:04.516 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T03:55:04.516 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.566 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T03:55:04.566 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T03:55:04.566 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.579 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T03:55:04.579 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T03:55:04.579 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.631 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T03:55:04.665 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T03:55:04.666 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T03:55:04.666 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.692 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T03:55:04.692 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T03:55:04.692 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.761 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T03:55:04.762 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T03:55:04.762 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.836 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T03:55:04.837 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T03:55:04.837 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.905 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T03:55:04.905 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T03:55:04.905 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:04.944 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T03:55:04.944 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T03:55:04.944 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.018 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T03:55:05.018 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T03:55:05.019 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.084 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T03:55:05.085 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T03:55:05.085 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.162 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T03:55:05.162 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T03:55:05.163 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T03:55:05.163 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.191 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T03:55:05.191 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T03:55:05.191 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.229 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T03:55:05.230 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T03:55:05.230 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T03:55:05.230 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.242 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T03:55:05.242 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T03:55:05.242 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.283 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T03:55:05.283 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T03:55:05.284 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T03:55:05.336 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T03:55:05.337 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T03:55:05.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-10T03:55:05.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:55:05.375 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T03:55:05.684 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:55:05.684 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T03:55:05.763 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:55:05.763 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T03:55:05.872 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:55:05.872 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T03:55:05.928 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:55:05.928 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T03:55:06.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:55:06.048 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T03:55:06.121 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:55:06.122 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T03:55:06.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:55:06.171 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T03:55:06.219 INFO:tasks.ceph:Archiving mon data... 2024-05-10T03:55:06.220 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/data/mon.a.tgz 2024-05-10T03:55:06.220 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-05-10T03:55:06.237 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.rbgBwcYzJz 2024-05-10T03:55:06.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rbgBwcYzJz 2024-05-10T03:55:06.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.rbgBwcYzJz 2024-05-10T03:55:06.450 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.rbgBwcYzJz is 276KB 2024-05-10T03:55:06.546 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.rbgBwcYzJz 2024-05-10T03:55:06.562 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/data/mon.b.tgz 2024-05-10T03:55:06.562 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-05-10T03:55:06.581 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.7nyHEBJBFA 2024-05-10T03:55:06.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7nyHEBJBFA 2024-05-10T03:55:06.728 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.7nyHEBJBFA 2024-05-10T03:55:06.816 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.7nyHEBJBFA is 376KB 2024-05-10T03:55:06.884 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.7nyHEBJBFA 2024-05-10T03:55:06.900 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/data/mon.c.tgz 2024-05-10T03:55:06.900 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-05-10T03:55:06.955 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.I2mNtfSGRo 2024-05-10T03:55:06.955 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.I2mNtfSGRo 2024-05-10T03:55:07.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.I2mNtfSGRo 2024-05-10T03:55:07.173 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.I2mNtfSGRo is 376KB 2024-05-10T03:55:07.242 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.I2mNtfSGRo 2024-05-10T03:55:07.258 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T03:55:07.258 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T03:55:07.261 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T03:55:07.346 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T03:55:07.380 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T03:55:07.380 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T03:55:07.382 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/remote/smithi055/crash 2024-05-10T03:55:07.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T03:55:07.415 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/remote/smithi064/crash 2024-05-10T03:55:07.416 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T03:55:07.446 INFO:tasks.ceph:Shutting down logrotate 2024-05-10T03:55:07.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:55:07.460 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T03:55:07.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T03:55:07.578 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T03:55:07.604 INFO:tasks.ceph:Compressing logs... 2024-05-10T03:55:07.605 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T03:55:07.624 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T03:55:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44390.log 2024-05-10T03:55:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42143.log 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.3.42143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42143.log.gz 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35438.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-05-10T03:55:07.691 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35598.log 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35598.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35598.log.gz 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-10T03:55:07.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.4.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.35689.log: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mgr.x.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35518.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35729.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35518.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-10T03:55:07.693 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35518.log.gz 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35729.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35729.log.gz 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41743.log 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42139.log 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.1.41743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41743.log.gz 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.1.41738.log 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.3.42139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42139.log.gz 2024-05-10T03:55:07.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.1.41738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41738.log.gz 2024-05-10T03:55:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-10T03:55:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35478.log 2024-05-10T03:55:07.695 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-10T03:55:07.696 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.35478.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35478.log.gz 2024-05-10T03:55:07.709 INFO:teuthology.orchestra.run.smithi064.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-10T03:55:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.2.44390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48987.log 2024-05-10T03:55:07.748 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44390.log.gz 2024-05-10T03:55:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42850.log 2024-05-10T03:55:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43208.log: /var/log/ceph/ceph-client.admin.48987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2024-05-10T03:55:07.748 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-05-10T03:55:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42850.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48987.log.gz 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42850.log.gz 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47207.log 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46466.log 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47207.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz -- 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.0.46930.log 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47207.log.gz 2024-05-10T03:55:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.46930.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46466.log.gz 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.46930.log.gz --verbose 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.46508.log 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41065.log 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46508.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41245.log 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2024-05-10T03:55:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41948.log 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41065.log.gz 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45471.log 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41948.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41245.log.gz 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41948.log.gz 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41510.log 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44779.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.45471.log.gz -5 2024-05-10T03:55:07.751 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45513.log 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41510.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49071.log 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41510.log.gz 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48759.log 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45513.log: /var/log/ceph/ceph-client.admin.49071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35383.log 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45513.log.gz 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48759.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49071.log.gz 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48381.log 2024-05-10T03:55:07.752 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48759.log.gz 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.35383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35383.log.gz 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46934.log 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48381.log.gz 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43460.log 2024-05-10T03:55:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.46934.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.46934.log.gz -5 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46550.log 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46550.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43460.log.gz 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44569.log: gzip -5 87.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46550.log.gz -- 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.48339.log 2024-05-10T03:55:07.754 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45859.log 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48339.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 89.1% 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48339.log.gz 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41161.log 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45859.log.gz 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47112.log 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41161.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29352.log 2024-05-10T03:55:07.755 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41161.log.gz 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45303.log 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47112.log.gz 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.tmp-client.admin.29352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48717.log 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29352.log.gz 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46592.log 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45303.log.gz 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47170.log 2024-05-10T03:55:07.756 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48717.log.gz 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47170.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46592.log.gz 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42074.log 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47170.log.gz 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41906.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47939.log 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47512.log 2024-05-10T03:55:07.757 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42074.log.gz 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47939.log.gz 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42032.log 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35645.log 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47512.log.gz 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44653.log: /var/log/ceph/ceph-client.admin.42032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-05-10T03:55:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.35645.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42032.log.gz 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48801.log 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35645.log.gz 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42969.log 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42969.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48801.log.gz 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2024-05-10T03:55:07.759 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42969.log.gz 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49321.log 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41636.log 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49321.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47300.log 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49321.log.gz 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41636.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-10T03:55:07.760 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41636.log.gz 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41822.log 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.3.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47300.log.gz 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45345.log 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41678.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41822.log.gz 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47343.log 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gz 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49029.log 2024-05-10T03:55:07.761 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45345.log.gz 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47343.log.gz 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49029.log.gz 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7%/var/log/ceph/ceph-client.admin.42626.log: -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2024-05-10T03:55:07.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46113.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46294.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46676.log 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45387.log 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46676.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-10T03:55:07.763 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45387.log.gz 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46676.log.gz 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-10T03:55:07.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42963.log 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42963.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47728.log 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42963.log.gz/var/log/ceph/ceph-client.admin.49239.log: 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48465.log 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2024-05-10T03:55:07.765 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47728.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47728.log.gz 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.0.43952.log 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41468.log 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48465.log.gz 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.43952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43952.log.gz 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46424.log 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42293.log 2024-05-10T03:55:07.766 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44086.log 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41468.log.gz 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46424.log.gz 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42293.log.gz 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47417.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44086.log.gz 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.43376.log 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44695.log: gzip -5 --verbose 89.4% -- /var/log/ceph/ceph-client.admin.42296.log 2024-05-10T03:55:07.767 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48149.log 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43376.log.gz 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42296.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42296.log.gz 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46071.log 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mon.a.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48149.log.gz 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-05-10T03:55:07.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44394.log 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46071.log.gz 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48945.log 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42634.log: /var/log/ceph/ceph-client.2.44394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44394.log.gz 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48591.log 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48945.log.gz 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2024-05-10T03:55:07.769 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41416.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48591.log.gz 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41738.log 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46252.log 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46029.log: /var/log/ceph/ceph-client.admin.41738.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41738.log.gz 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44932.log 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-05-10T03:55:07.770 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46252.log.gz 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44611.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44932.log.gz 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42631.log 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41864.log 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42631.log: /var/log/ceph/ceph-client.admin.44527.log: 87.9% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42631.log.gz 2024-05-10T03:55:07.771 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42849.log 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41864.log.gz 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42291.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42849.log.gz 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45429.log 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42964.log: -- /var/log/ceph/ceph-client.admin.48423.log 2024-05-10T03:55:07.772 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47572.log 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45429.log.gz 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48423.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47572.log: /var/log/ceph/ceph-client.admin.43250.log: 90.2% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47572.log.gz 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gz 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2024-05-10T03:55:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48675.log 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42116.log 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48675.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45987.log 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48675.log.gz 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42116.log: /var/log/ceph/ceph-client.admin.45987.log: 88.4% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42116.log.gz 2024-05-10T03:55:07.774 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45987.log.gz 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43334.log 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41552.log 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43947.log 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41552.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43334.log.gz 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47380.log 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41552.log.gz 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.43947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-05-10T03:55:07.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43947.log.gz 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42297.log 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47380.log.gz 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42625.log 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42297.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42297.log.gz 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-05-10T03:55:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42625.log: /var/log/ceph/ceph-client.admin.42292.log: 87.1% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42625.log.gz 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41780.log 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45555.log 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45555.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41780.log.gz 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 88.3% 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45555.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46157.log 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-05-10T03:55:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5/var/log/ceph/ceph-client.admin.46201.log: --verbose -- /var/log/ceph/ceph-client.admin.41329.log 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46157.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47489.log 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46157.log.gz 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:gzip/var/log/ceph/ceph-client.admin.41329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45261.log 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47489.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41329.log.gz 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49279.log 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47489.log.gz 2024-05-10T03:55:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42968.log 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48507.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48023.log 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0%/var/log/ceph/ceph-client.admin.42968.log: -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42968.log.gz 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.45615.log 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48023.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48023.log.gz 2024-05-10T03:55:07.779 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.47813.log 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45615.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.47855.log 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45615.log.gz 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45177.log 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47813.log.gz 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47855.log.gz 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2024-05-10T03:55:07.780 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45177.log.gz 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49197.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43166.log 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41594.log 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49197.log.gz 2024-05-10T03:55:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42630.log 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43166.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41594.log: /var/log/ceph/ceph-client.admin.42630.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41594.log.gz 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49155.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42630.log.gz 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47244.log 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-05-10T03:55:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.47244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48843.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47244.log.gz 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45695.log 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.41990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48065.log 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42970.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45695.log.gz 2024-05-10T03:55:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48107.log 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45817.log 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48107.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48065.log.gz 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48107.log.gz 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42633.log: /var/log/ceph/ceph-client.admin.45817.log: 87.5% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2024-05-10T03:55:07.784 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45100.log 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45775.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2024-05-10T03:55:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41287.log 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45100.log: /var/log/ceph/ceph-client.admin.45010.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45100.log.gz 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48885.log: /var/log/ceph/ceph-client.admin.41287.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41287.log.gz 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42288.log 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.35748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2024-05-10T03:55:07.786 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-05-10T03:55:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42288.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42288.log.gz 2024-05-10T03:55:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2024-05-10T03:55:07.788 INFO:teuthology.orchestra.run.smithi055.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-10T03:55:07.788 INFO:teuthology.orchestra.run.smithi055.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-10T03:55:07.788 INFO:teuthology.orchestra.run.smithi064.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-10T03:55:07.788 INFO:teuthology.orchestra.run.smithi064.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-10T03:55:07.788 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-10T03:55:07.792 INFO:teuthology.orchestra.run.smithi055.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-10T03:55:07.799 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-10T03:55:07.805 INFO:teuthology.orchestra.run.smithi055.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-10T03:55:07.818 INFO:teuthology.orchestra.run.smithi055.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-10T03:55:07.821 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-10T03:55:07.839 INFO:teuthology.orchestra.run.smithi055.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-10T03:55:07.839 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-10T03:55:07.841 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-05-10T03:55:07.841 INFO:teuthology.orchestra.run.smithi055.stderr:real 0m0.204s 2024-05-10T03:55:07.841 INFO:teuthology.orchestra.run.smithi055.stderr:user 0m0.810s 2024-05-10T03:55:07.842 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m0.147s 2024-05-10T03:55:07.842 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-05-10T03:55:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:real 0m0.182s 2024-05-10T03:55:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:user 0m0.730s 2024-05-10T03:55:07.843 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m0.044s 2024-05-10T03:55:07.843 INFO:tasks.ceph:Archiving logs... 2024-05-10T03:55:07.843 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/remote/smithi055/log 2024-05-10T03:55:07.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T03:55:08.125 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/remote/smithi064/log 2024-05-10T03:55:08.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T03:55:08.246 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T03:55:08.263 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T03:55:08.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T03:55:08.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T03:55:08.339 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T03:55:08.348 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T03:55:08.349 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:55:08.351 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T03:55:08.363 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-05-10T03:55:08.366 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-05-10T03:55:08.369 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:55:08.369 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-05-10T03:55:08.369 INFO:teuthology.orchestra.run.smithi055.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +1964us[+1948us] +/- 42ms 2024-05-10T03:55:08.369 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -2317us[-2332us] +/- 65ms 2024-05-10T03:55:08.369 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 -715us[ -715us] +/- 63ms 2024-05-10T03:55:08.369 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:55:08.370 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T03:55:08.371 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-05-10T03:55:08.371 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +1971us[+1964us] +/- 42ms 2024-05-10T03:55:08.371 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -2319us[-2319us] +/- 65ms 2024-05-10T03:55:08.371 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -705us[ -705us] +/- 63ms 2024-05-10T03:55:08.371 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T03:55:08.372 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T03:55:08.381 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T03:55:08.381 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T03:55:08.418 DEBUG:teuthology.orchestra.run.smithi055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T03:55:08.486 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T03:55:08.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T03:55:08.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:55:08.578 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T03:55:08.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:55:08.606 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T03:55:08.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T03:55:08.635 INFO:teuthology.task.internal:Duration was 528.463028 seconds 2024-05-10T03:55:08.636 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T03:55:08.678 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T03:55:08.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T03:55:08.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T03:55:08.719 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:55:08.721 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T03:55:09.024 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T03:55:09.025 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2024-05-10T03:55:09.025 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T03:55:09.046 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-05-10T03:55:09.049 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T03:55:09.091 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T03:55:09.091 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:55:09.094 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T03:55:09.159 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T03:55:09.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T03:55:09.162 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T03:55:09.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T03:55:09.309 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T03:55:09.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T03:55:09.335 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T03:55:09.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T03:55:09.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:55:09.378 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:55:09.399 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2024-05-10T03:55:09.426 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-05-10T03:55:09.440 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:55:09.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:55:09.469 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T03:55:09.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T03:55:09.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T03:55:09.504 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T03:55:09.505 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/remote/smithi055 2024-05-10T03:55:09.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T03:55:09.545 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660/remote/smithi064 2024-05-10T03:55:09.545 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T03:55:09.579 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T03:55:09.579 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T03:55:09.582 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T03:55:09.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T03:55:09.642 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T03:55:09.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T03:55:09.661 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T03:55:09.662 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T03:55:09.664 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T03:55:09.677 INFO:teuthology.orchestra.run.smithi055.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 03:55 /home/ubuntu/cephtest 2024-05-10T03:55:09.685 INFO:teuthology.orchestra.run.smithi064.stdout: 265307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 03:55 /home/ubuntu/cephtest 2024-05-10T03:55:09.686 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T03:55:09.711 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T03:55:09.817 INFO:teuthology.nuke:Checking targets against current locks 2024-05-10T03:55:09.844 DEBUG:teuthology.nuke:shortname: smithi055 2024-05-10T03:55:09.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:55:09.870 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:37:47.667031', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7FdJqdCHwolGpq9tqq5sqt4A6W4cTa2wZdqVnN5Qhtb8LuMx74etxifhyELUMWKVrob5sHcn+JJFd7R3XeRS8='} 2024-05-10T03:55:09.874 DEBUG:teuthology.nuke:shortname: smithi064 2024-05-10T03:55:09.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T03:55:09.896 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-05-10_03:34:35-fs:functional-wip-jcollin-testing-07052024-distro-default-smithi/7700660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 03:37:47.668872', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUGkTzYTWonc2cRDiutYhQBE8zNNzT2G6by0wxOOXpcaq4LiY+1urCib9rfIC2+PQ+1pqBjXL3HW4Bd3chenys='} 2024-05-10T03:55:09.926 INFO:teuthology.orchestra.console.smithi055:Power off 2024-05-10T03:55:09.927 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T03:55:09.957 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-05-10T03:55:09.957 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:09.973 INFO:teuthology.orchestra.console.smithi064:Power off 2024-05-10T03:55:09.973 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T03:55:09.984 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-05-10T03:55:09.998 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-05-10T03:55:09.998 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:10.027 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-05-10T03:55:13.985 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:14.028 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:14.097 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-05-10T03:55:14.139 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-05-10T03:55:18.102 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:18.140 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:18.213 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-05-10T03:55:18.250 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-05-10T03:55:18.350 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-05-10T03:55:22.217 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T03:55:22.327 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-05-10T03:55:22.428 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-05-10T03:55:22.533 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} duration: 528.4630284309387 failure_reason: 'Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)' flavor: default owner: scheduled_jcollin@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=984f2e041f6742588dfcb3a74dd875ea status: fail success: false 2024-05-10T03:55:22.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T03:55:22.632 INFO:teuthology.run:FAIL